[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:22 dist-test-slave-xw35 krb5kdc[1254](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:22 dist-test-slave-xw35 krb5kdc[1254](info): set up 2 sockets
Jun 20 22:03:22 dist-test-slave-xw35 krb5kdc[1254](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260620 22:03:22.950266 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.954s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:23.054541 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:43503
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:43503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:23.128391 1267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:23.128571 1267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:23.128592 1267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:23.129655 1267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:23.129693 1267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:23.129706 1267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:23.129719 1267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:23.129730 1267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:23.131150 1267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:43503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:43503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:23.131309 1267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:23.131474 1267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:23.136571 1272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:23.136623 1267 server_base.cc:1034] running on GCE node
W20260620 22:03:23.136734 1273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:23.136647 1275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:23.137020 1267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:23.137306 1267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:23.138459 1267 hybrid_clock.cc:648] HybridClock initialized: now 1781993003138445 us; error 42 us; skew 500 ppm
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:23.140625 1267 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:23.141027 1267 webserver.cc:460] Webserver started at http://127.1.55.254:37237/ using document root <none> and password file <none>
I20260620 22:03:23.141238 1267 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:23.141323 1267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:23.141465 1267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:23.142443 1267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "5c18073882b344bfb13e5adf87302b26"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "ec375b1865119c0204e2934f316a5d42"
server_key_iv: "aee17d893367db25eb0f549681220a63"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.142805 1267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "5c18073882b344bfb13e5adf87302b26"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "ec375b1865119c0204e2934f316a5d42"
server_key_iv: "aee17d893367db25eb0f549681220a63"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.144172 1267 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:23.144820 1282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.144974 1267 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:23.145076 1267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "5c18073882b344bfb13e5adf87302b26"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "ec375b1865119c0204e2934f316a5d42"
server_key_iv: "aee17d893367db25eb0f549681220a63"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.145149 1267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:23.165110 1267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:23.167681 1267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:23.168102 1267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:23.172916 1267 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:43503
I20260620 22:03:23.172962 1334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:43503 every 8 connection(s)
I20260620 22:03:23.173295 1267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:23.174547 1335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:23.177065 1335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26: Bootstrap starting.
I20260620 22:03:23.177631 1335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:23.177883 1335 log.cc:824] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:23.178453 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 1267
I20260620 22:03:23.178560 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:23.179327 1247 external_mini_cluster.cc:1428] Setting key c61d71324f3bb6282ec8b9651b407768
I20260620 22:03:23.180295 1335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26: No bootstrap required, opened a new log
I20260620 22:03:23.182086 1335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c18073882b344bfb13e5adf87302b26" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43503 } }
I20260620 22:03:23.182220 1335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:23.182262 1335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c18073882b344bfb13e5adf87302b26, State: Initialized, Role: FOLLOWER
I20260620 22:03:23.182404 1335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c18073882b344bfb13e5adf87302b26" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43503 } }
I20260620 22:03:23.182492 1335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:23.182548 1335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:23.182605 1335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:23.183561 1335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c18073882b344bfb13e5adf87302b26" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43503 } }
I20260620 22:03:23.183663 1335 leader_election.cc:302] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c18073882b344bfb13e5adf87302b26; no voters:
I20260620 22:03:23.183820 1335 leader_election.cc:288] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:23.183849 1340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:23.184083 1340 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [term 1 LEADER]: Becoming Leader. State: Replica: 5c18073882b344bfb13e5adf87302b26, State: Running, Role: LEADER
I20260620 22:03:23.184120 1335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:23.184239 1340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c18073882b344bfb13e5adf87302b26" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43503 } }
I20260620 22:03:23.184633 1341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c18073882b344bfb13e5adf87302b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c18073882b344bfb13e5adf87302b26" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43503 } } }
I20260620 22:03:23.184700 1341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:23.184815 1341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c18073882b344bfb13e5adf87302b26. Latest consensus state: current_term: 1 leader_uuid: "5c18073882b344bfb13e5adf87302b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c18073882b344bfb13e5adf87302b26" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43503 } } }
I20260620 22:03:23.184860 1341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26 [sys.catalog]: This master's current role is: LEADER
W20260620 22:03:23.185863 1356 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:03:23.186721 1356 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:03:23.186846 1348 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:23.187103 1348 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:23.188557 1348 catalog_manager.cc:1347] Generated new cluster ID: 453b0d8f75384c4b904c61012e7e0d00
I20260620 22:03:23.188612 1348 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:23.197569 1339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.180758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35398 (local address 127.1.55.254:43503)
0620 22:03:23.180957 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:23.180966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:23.181805 (+ 839us) server_negotiation.cc:407] Connection header received
0620 22:03:23.183948 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:23.183955 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:23.184012 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:23.186891 (+ 2879us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:23.186986 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.188175 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.189591 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.190115 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.191061 (+ 946us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.193823 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:23.193827 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:23.193827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:23.193837 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:23.195537 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.195941 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.195944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.195944 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.196037 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.196253 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.196253 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.196253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.196487 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:23.196610 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:23.197259 (+ 649us) server_negotiation.cc:299] Negotiation successful
0620 22:03:23.197366 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260620 22:03:23.201644 1348 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:23.202358 1348 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:23.208683 1348 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c18073882b344bfb13e5adf87302b26: Generated new TSK 0
I20260620 22:03:23.208845 1348 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:23.234360 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:43503
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:23.322834 1361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:23.323009 1361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:23.323032 1361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:23.324113 1361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:23.324151 1361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:23.324177 1361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:23.325610 1361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:43503
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:23.325798 1361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:23.326012 1361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:23.330602 1369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:23.330632 1366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:23.330670 1367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:23.330826 1361 server_base.cc:1034] running on GCE node
I20260620 22:03:23.331092 1361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:23.331326 1361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:23.332463 1361 hybrid_clock.cc:648] HybridClock initialized: now 1781993003332453 us; error 26 us; skew 500 ppm
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:23.334894 1361 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:23.335322 1361 webserver.cc:460] Webserver started at http://127.1.55.193:35845/ using document root <none> and password file <none>
I20260620 22:03:23.335583 1361 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:23.335621 1361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:23.335742 1361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:23.336627 1361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "09041135384d491d8dea07ee966078e0"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "735b1267709acd664e631009737d4d6e"
server_key_iv: "3a90cd491a1c9d63b78f5294d7614416"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.336937 1361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "09041135384d491d8dea07ee966078e0"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "735b1267709acd664e631009737d4d6e"
server_key_iv: "3a90cd491a1c9d63b78f5294d7614416"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.338181 1361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260620 22:03:23.338847 1376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.338982 1361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:23.339056 1361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "09041135384d491d8dea07ee966078e0"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "735b1267709acd664e631009737d4d6e"
server_key_iv: "3a90cd491a1c9d63b78f5294d7614416"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.339102 1361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:23.350617 1361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:23.352613 1361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:23.352706 1361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:23.352850 1361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:23.353084 1361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:23.353112 1361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.353132 1361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:23.353143 1361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.358474 1361 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:34165
I20260620 22:03:23.358516 1489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:34165 every 8 connection(s)
I20260620 22:03:23.358807 1361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:23.358973 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 1361
I20260620 22:03:23.359076 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:23.359236 1247 external_mini_cluster.cc:1428] Setting key 5971384d5ab0e74c64493a2359576744
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
I20260620 22:03:23.368135 1339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.359541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:52695 (local address 127.1.55.254:43503)
0620 22:03:23.359613 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:23.359615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:23.359783 (+ 168us) server_negotiation.cc:407] Connection header received
0620 22:03:23.360249 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:23.360250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:23.360264 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:23.360331 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:23.361161 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.361999 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.362914 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.363172 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.363252 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.365570 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:23.365571 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:23.365571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:23.365577 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:23.366805 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.367273 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.367273 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.367274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.367320 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.367564 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.367564 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.367565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.367659 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:23.367710 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:23.367940 (+ 230us) server_negotiation.cc:299] Negotiation successful
0620 22:03:23.368056 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260620 22:03:23.368245 1492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.359486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:43503 (local address 127.1.55.193:52695)
0620 22:03:23.359660 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:23.359698 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:23.360147 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:23.360374 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:23.360377 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:23.360922 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:23.361088 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:23.361092 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.362092 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.362092 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:23.362807 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:23.362808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.363268 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.363269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:23.363401 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.363889 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:23.363897 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:23.365435 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:23.366893 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:23.366899 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:23.366901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:23.367197 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:23.367381 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:23.367382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:23.367382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:23.367507 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:23.367716 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:23.367720 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:23.367827 (+ 107us) client_negotiation.cc:769] Sending connection context
0620 22:03:23.367899 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 22:03:23.368082 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":106,"threads_started":1}
I20260620 22:03:23.368701 1490 heartbeater.cc:347] Connected to a master server at 127.1.55.254:43503
I20260620 22:03:23.368789 1490 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:23.368937 1490 heartbeater.cc:511] Master 127.1.55.254:43503 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
I20260620 22:03:23.369407 1299 ts_manager.cc:194] Registered new tserver with Master: 09041135384d491d8dea07ee966078e0 (127.1.55.193:34165)
I20260620 22:03:23.369984 1299 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:52695
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:23.381336 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:43503
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:23.453745 1495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:23.453907 1495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:23.453929 1495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:23.455025 1495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:23.455076 1495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:23.455144 1495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:23.456471 1495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:43503
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:23.456622 1495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:23.456818 1495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:03:23.461515 1495 server_base.cc:1034] running on GCE node
W20260620 22:03:23.461470 1503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:23.461404 1500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:23.461439 1501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:23.461792 1495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:23.462002 1495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:23.463150 1495 hybrid_clock.cc:648] HybridClock initialized: now 1781993003463133 us; error 28 us; skew 500 ppm
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:23.465416 1495 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:23.465822 1495 webserver.cc:460] Webserver started at http://127.1.55.194:41433/ using document root <none> and password file <none>
I20260620 22:03:23.466044 1495 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:23.466109 1495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:23.466252 1495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:23.467128 1495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "01075532c993452bb90b2f4c822a24d4"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "37b783c1d0544ba196ef4a714d69c406"
server_key_iv: "8a975c4e077caf2cfae49ac7420f0f12"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.467486 1495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "01075532c993452bb90b2f4c822a24d4"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "37b783c1d0544ba196ef4a714d69c406"
server_key_iv: "8a975c4e077caf2cfae49ac7420f0f12"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.468706 1495 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:03:23.469297 1510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.469451 1495 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:23.469569 1495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "01075532c993452bb90b2f4c822a24d4"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "37b783c1d0544ba196ef4a714d69c406"
server_key_iv: "8a975c4e077caf2cfae49ac7420f0f12"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.469642 1495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:23.477198 1495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:23.478790 1495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:23.478962 1495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:23.479171 1495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:23.479444 1495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:23.479496 1495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.479529 1495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:23.479555 1495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.485112 1495 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:46131
I20260620 22:03:23.485175 1623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:46131 every 8 connection(s)
I20260620 22:03:23.485498 1495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:23.492944 1339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.486139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:37757 (local address 127.1.55.254:43503)
0620 22:03:23.486180 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:23.486182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:23.486350 (+ 168us) server_negotiation.cc:407] Connection header received
0620 22:03:23.486715 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:23.486716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:23.486724 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:23.486771 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:23.487550 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.488015 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.488842 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.488997 (+ 155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.489066 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.490770 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:23.490771 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:23.490771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:23.490778 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:23.491746 (+ 968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.492110 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.492111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.492111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.492167 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.492392 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.492392 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.492393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.492494 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:23.492558 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:23.492793 (+ 235us) server_negotiation.cc:299] Negotiation successful
0620 22:03:23.492862 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:03:23.493115 1626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.486105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:43503 (local address 127.1.55.194:37757)
0620 22:03:23.486247 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:23.486282 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:23.486642 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:23.486812 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:23.486815 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:23.487296 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:23.487481 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:23.487485 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.488083 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.488084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:23.488777 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:23.488778 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.489085 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.489085 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:23.489164 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.489534 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:23.489542 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:23.490686 (+ 1144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:23.491819 (+ 1133us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:23.491824 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:23.491826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:23.492026 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:23.492226 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:23.492227 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:23.492228 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:23.492326 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:23.492560 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:23.492566 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:23.492681 (+ 115us) client_negotiation.cc:769] Sending connection context
0620 22:03:23.492775 (+ 94us) client_negotiation.cc:240] Negotiation successful
0620 22:03:23.492900 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":79,"threads_started":1}
I20260620 22:03:23.493600 1624 heartbeater.cc:347] Connected to a master server at 127.1.55.254:43503
I20260620 22:03:23.493686 1624 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:23.493841 1624 heartbeater.cc:511] Master 127.1.55.254:43503 requested a full tablet report, sending...
I20260620 22:03:23.494210 1299 ts_manager.cc:194] Registered new tserver with Master: 01075532c993452bb90b2f4c822a24d4 (127.1.55.194:46131)
I20260620 22:03:23.494590 1299 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:37757
I20260620 22:03:23.494858 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 1495
I20260620 22:03:23.494947 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:23.495092 1247 external_mini_cluster.cc:1428] Setting key 1d9da9ebfa7e618bbcc5605b6743ee2c
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:23.515715 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:43503
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:23.592549 1629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:23.592708 1629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:23.592729 1629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:23.593878 1629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:23.593932 1629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:23.593981 1629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:23.595314 1629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:43503
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:23.595528 1629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:23.595721 1629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:23.600054 1635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:23.600092 1634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:23.600062 1637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:23.600188 1629 server_base.cc:1034] running on GCE node
I20260620 22:03:23.600340 1629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:23.600541 1629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:23.601682 1629 hybrid_clock.cc:648] HybridClock initialized: now 1781993003601669 us; error 41 us; skew 500 ppm
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:23.603861 1629 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:23.604295 1629 webserver.cc:460] Webserver started at http://127.1.55.195:46581/ using document root <none> and password file <none>
I20260620 22:03:23.604502 1629 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:23.604585 1629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:23.604705 1629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:23.605667 1629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "b47cb30a09ce43f1a5e447912cc815d6"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "32d43e3b425d4847beaaf40bad36c682"
server_key_iv: "ee135d8265977174bfef71505dc4fba3"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.606001 1629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "b47cb30a09ce43f1a5e447912cc815d6"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "32d43e3b425d4847beaaf40bad36c682"
server_key_iv: "ee135d8265977174bfef71505dc4fba3"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.607193 1629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:23.607823 1644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.607992 1629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:23.608083 1629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "b47cb30a09ce43f1a5e447912cc815d6"
format_stamp: "Formatted at 2026-06-20 22:03:23 on dist-test-slave-xw35"
server_key: "32d43e3b425d4847beaaf40bad36c682"
server_key_iv: "ee135d8265977174bfef71505dc4fba3"
server_key_version: "encryptionkey@0"
I20260620 22:03:23.608161 1629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:23.632162 1629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:23.633862 1629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:23.634014 1629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:23.634213 1629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:23.634479 1629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:23.634543 1629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.634579 1629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:23.634606 1629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:23.640199 1629 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:37131
I20260620 22:03:23.640228 1757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:37131 every 8 connection(s)
I20260620 22:03:23.640482 1629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:23.648737 1339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.641056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:58329 (local address 127.1.55.254:43503)
0620 22:03:23.641096 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:23.641097 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:23.641276 (+ 179us) server_negotiation.cc:407] Connection header received
0620 22:03:23.641776 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:23.641777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:23.641788 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:23.641842 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:23.642653 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.643095 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.644042 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.644229 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.644333 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.646166 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:23.646167 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:23.646167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:23.646174 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:23.647439 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.647832 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.647834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.647834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.647892 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.648118 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.648119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.648120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.648230 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:23.648304 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:23.648593 (+ 289us) server_negotiation.cc:299] Negotiation successful
0620 22:03:23.648661 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:03:23.648876 1760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.641038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:43503 (local address 127.1.55.195:58329)
0620 22:03:23.641180 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:23.641208 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:23.641682 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:23.641908 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:23.641911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:23.642374 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:23.642526 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:23.642529 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.643185 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.643186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:23.643948 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:23.643950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.644338 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.644339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:23.644461 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.644845 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:23.644853 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:23.646068 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:23.647525 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:23.647530 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:23.647532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:23.647733 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:23.647955 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:23.647956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:23.647957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:23.648052 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:23.648294 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:23.648300 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:23.648418 (+ 118us) client_negotiation.cc:769] Sending connection context
0620 22:03:23.648576 (+ 158us) client_negotiation.cc:240] Negotiation successful
0620 22:03:23.648695 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
I20260620 22:03:23.649307 1758 heartbeater.cc:347] Connected to a master server at 127.1.55.254:43503
I20260620 22:03:23.649370 1758 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:23.649559 1758 heartbeater.cc:511] Master 127.1.55.254:43503 requested a full tablet report, sending...
I20260620 22:03:23.649590 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 1629
I20260620 22:03:23.649683 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:23.649853 1247 external_mini_cluster.cc:1428] Setting key 18fe14116877626d9480de21871ceca8
I20260620 22:03:23.649909 1299 ts_manager.cc:194] Registered new tserver with Master: b47cb30a09ce43f1a5e447912cc815d6 (127.1.55.195:37131)
I20260620 22:03:23.650368 1299 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:58329
I20260620 22:03:23.650905 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:23.670876 1765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.664216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53412 (local address 127.1.55.193:34165)
0620 22:03:23.664356 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:23.664364 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:23.664373 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:23.664394 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:23.664396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:23.664407 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:23.664469 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:23.664957 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.665630 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.666219 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.666470 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.666518 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.668560 (+ 2042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:23.668568 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:23.668568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:23.668588 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:23.669813 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.670142 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.670146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.670147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.670196 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.670389 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.670390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.670390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.670504 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:23.670657 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:23.670699 (+ 42us) server_negotiation.cc:299] Negotiation successful
0620 22:03:23.670766 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
W20260620 22:03:23.671175 1404 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53412
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1254](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:23.690239 1765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:23.684468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53422 (local address 127.1.55.193:34165)
0620 22:03:23.684523 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:23.684525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:23.684684 (+ 159us) server_negotiation.cc:407] Connection header received
0620 22:03:23.684709 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:23.684710 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:23.684718 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:23.684768 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:23.685217 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.685704 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.686292 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:23.686453 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:23.686495 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:23.688289 (+ 1794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:23.688290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:23.688290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:23.688297 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:23.689407 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.689721 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.689721 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.689721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.689762 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:23.689894 (+ 132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:23.689894 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:23.689894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:23.689957 (+ 63us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:23.690034 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:23.690093 (+ 59us) server_negotiation.cc:299] Negotiation successful
0620 22:03:23.690141 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 22:03:23.690709 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 1361
I20260620 22:03:23.695940 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 1495
I20260620 22:03:23.700748 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 1629
I20260620 22:03:23.704720 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 1267
2026-06-20T22:03:23Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1732 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1772](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1772](info): set up 2 sockets
Jun 20 22:03:23 dist-test-slave-xw35 krb5kdc[1772](info): commencing operation
krb5kdc: starting...
W20260620 22:03:24.672518 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.949s user 0.002s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:24 dist-test-slave-xw35 krb5kdc[1772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:24.774169 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38757
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:41967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:24.846457 1785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:24.846642 1785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:24.846673 1785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:24.847785 1785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:24.847846 1785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:24.847872 1785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:24.847901 1785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:24.847925 1785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:24.849257 1785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:41967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:24.849512 1785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:24.849709 1785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:24.854022 1793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:24.854034 1790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:24.854040 1791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:24.854111 1785 server_base.cc:1034] running on GCE node
I20260620 22:03:24.854462 1785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:24.854705 1785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:24.855831 1785 hybrid_clock.cc:648] HybridClock initialized: now 1781993004855821 us; error 25 us; skew 500 ppm
Jun 20 22:03:24 dist-test-slave-xw35 krb5kdc[1772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993004, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:24.858083 1785 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:24.858448 1785 webserver.cc:460] Webserver started at http://127.1.55.254:33663/ using document root <none> and password file <none>
I20260620 22:03:24.858656 1785 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:24.858717 1785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:24.858850 1785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:24.859721 1785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "2777c15f7b794574bbdf9c8dd46bb18e"
format_stamp: "Formatted at 2026-06-20 22:03:24 on dist-test-slave-xw35"
server_key: "990aa63a1586d3c8ee83ac47facf3281"
server_key_iv: "d8a958926d80f67ed2dbbd1db8561050"
server_key_version: "encryptionkey@0"
I20260620 22:03:24.860044 1785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "2777c15f7b794574bbdf9c8dd46bb18e"
format_stamp: "Formatted at 2026-06-20 22:03:24 on dist-test-slave-xw35"
server_key: "990aa63a1586d3c8ee83ac47facf3281"
server_key_iv: "d8a958926d80f67ed2dbbd1db8561050"
server_key_version: "encryptionkey@0"
I20260620 22:03:24.861171 1785 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:03:24.861860 1800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:24.862013 1785 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:24.862102 1785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "2777c15f7b794574bbdf9c8dd46bb18e"
format_stamp: "Formatted at 2026-06-20 22:03:24 on dist-test-slave-xw35"
server_key: "990aa63a1586d3c8ee83ac47facf3281"
server_key_iv: "d8a958926d80f67ed2dbbd1db8561050"
server_key_version: "encryptionkey@0"
I20260620 22:03:24.862169 1785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:24.884054 1785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:24.886189 1785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:24.886368 1785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:24.889724 1785 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:38757
I20260620 22:03:24.889755 1852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:38757 every 8 connection(s)
I20260620 22:03:24.890033 1785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:24.890758 1853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:24.892647 1853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e: Bootstrap starting.
I20260620 22:03:24.893183 1853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:24.893477 1853 log.cc:824] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:24.894183 1853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e: No bootstrap required, opened a new log
I20260620 22:03:24.895673 1853 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2777c15f7b794574bbdf9c8dd46bb18e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38757 } }
I20260620 22:03:24.895790 1853 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:24.895833 1853 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2777c15f7b794574bbdf9c8dd46bb18e, State: Initialized, Role: FOLLOWER
I20260620 22:03:24.895961 1853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2777c15f7b794574bbdf9c8dd46bb18e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38757 } }
I20260620 22:03:24.896023 1853 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:24.896044 1853 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:24.896106 1853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:24.896569 1853 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2777c15f7b794574bbdf9c8dd46bb18e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38757 } }
I20260620 22:03:24.896670 1853 leader_election.cc:302] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2777c15f7b794574bbdf9c8dd46bb18e; no voters:
I20260620 22:03:24.896839 1853 leader_election.cc:288] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:24.896873 1856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:24.897040 1856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [term 1 LEADER]: Becoming Leader. State: Replica: 2777c15f7b794574bbdf9c8dd46bb18e, State: Running, Role: LEADER
I20260620 22:03:24.897069 1853 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:24.897143 1856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2777c15f7b794574bbdf9c8dd46bb18e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38757 } }
I20260620 22:03:24.897549 1857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2777c15f7b794574bbdf9c8dd46bb18e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2777c15f7b794574bbdf9c8dd46bb18e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38757 } } }
I20260620 22:03:24.897558 1858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2777c15f7b794574bbdf9c8dd46bb18e. Latest consensus state: current_term: 1 leader_uuid: "2777c15f7b794574bbdf9c8dd46bb18e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2777c15f7b794574bbdf9c8dd46bb18e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38757 } } }
I20260620 22:03:24.897661 1858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:24.897640 1857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:24.897900 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 1785
I20260620 22:03:24.897991 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:24.898167 1247 external_mini_cluster.cc:1428] Setting key b3208c103facf9e2c4a9866dd0e518ab
W20260620 22:03:24.899755 1874 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:03:24.899837 1874 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:03:24.899887 1861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:24.900012 1861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:24.901404 1861 catalog_manager.cc:1347] Generated new cluster ID: 65d5780d88e04ecfb9ab09544e58f4de
I20260620 22:03:24.901454 1861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:03:24 dist-test-slave-xw35 krb5kdc[1772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:24.908412 1861 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:24.908712 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:24.898658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41366 (local address 127.1.55.254:38757)
0620 22:03:24.898789 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:24.898797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:24.898833 (+ 36us) server_negotiation.cc:407] Connection header received
0620 22:03:24.898939 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:24.898944 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:24.898981 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:24.899115 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:24.899836 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:24.901111 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:24.901979 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:24.902375 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:24.902501 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:24.904789 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:24.904793 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:24.904793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:24.904803 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:24.906973 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:24.907369 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:24.907371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:24.907372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:24.907478 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:24.907688 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:24.907688 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:24.907689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:24.907910 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:24.908094 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:24.908372 (+ 278us) server_negotiation.cc:299] Negotiation successful
0620 22:03:24.908509 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":63,"threads_started":1}
I20260620 22:03:24.909072 1861 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:24.916049 1861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2777c15f7b794574bbdf9c8dd46bb18e: Generated new TSK 0
I20260620 22:03:24.916198 1861 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:24.943742 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38757
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:41967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:25.018184 1879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:25.018375 1879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:25.018411 1879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:25.019511 1879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:25.019569 1879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:25.019611 1879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:25.021031 1879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:41967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:25.021270 1879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:25.021551 1879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:25.026108 1884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:25.026105 1885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:25.026105 1887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:25.026481 1879 server_base.cc:1034] running on GCE node
I20260620 22:03:25.026710 1879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:25.026917 1879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:25.028046 1879 hybrid_clock.cc:648] HybridClock initialized: now 1781993005028040 us; error 31 us; skew 500 ppm
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:25.030332 1879 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:25.030730 1879 webserver.cc:460] Webserver started at http://127.1.55.193:40901/ using document root <none> and password file <none>
I20260620 22:03:25.030944 1879 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:25.031016 1879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:25.031157 1879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:25.032119 1879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "1bbb74c9ecd141149899990477772a51"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "2359e67a2a9133106b73268b8cb0909d"
server_key_iv: "be0514d676dd1613f22b24f2f0116da2"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.032449 1879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "1bbb74c9ecd141149899990477772a51"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "2359e67a2a9133106b73268b8cb0909d"
server_key_iv: "be0514d676dd1613f22b24f2f0116da2"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.033757 1879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:03:25.034431 1894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.034576 1879 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.034672 1879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "1bbb74c9ecd141149899990477772a51"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "2359e67a2a9133106b73268b8cb0909d"
server_key_iv: "be0514d676dd1613f22b24f2f0116da2"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.034746 1879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:25.042749 1879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:25.044351 1879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:25.044497 1879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:25.044721 1879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:25.044966 1879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:25.045020 1879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.045056 1879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:25.045081 1879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.050578 1879 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:43611
I20260620 22:03:25.050621 2007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:43611 every 8 connection(s)
I20260620 22:03:25.050911 1879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:25.057725 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 1879
I20260620 22:03:25.057811 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:25.057940 1247 external_mini_cluster.cc:1428] Setting key 0973cc5000bb193a41590ca1a69abab7
I20260620 22:03:25.059507 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.051581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:42465 (local address 127.1.55.254:38757)
0620 22:03:25.051653 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.051655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.051814 (+ 159us) server_negotiation.cc:407] Connection header received
0620 22:03:25.052620 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.052620 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.052631 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.052677 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:25.053154 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.053702 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.054679 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.054859 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.054902 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.056772 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:25.056774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:25.056774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:25.056780 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:25.058166 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.058596 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.058597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.058597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.058658 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.058941 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.058941 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.058942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.059032 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:25.059079 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.059393 (+ 314us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.059453 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260620 22:03:25.059718 2010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.051543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38757 (local address 127.1.55.193:42465)
0620 22:03:25.051690 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:25.051719 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:25.052539 (+ 820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:25.052722 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:25.052725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:25.052936 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:25.053089 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.053093 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.053798 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.053799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.054588 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.054590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.054924 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.054925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.055010 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.055486 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:25.055500 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:25.056695 (+ 1195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:25.058233 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:25.058254 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:25.058256 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:25.058510 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:25.058744 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:25.058745 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:25.058746 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:25.058879 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:25.059091 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:25.059096 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:25.059248 (+ 152us) client_negotiation.cc:769] Sending connection context
0620 22:03:25.059342 (+ 94us) client_negotiation.cc:240] Negotiation successful
0620 22:03:25.059483 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260620 22:03:25.060438 2008 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38757
I20260620 22:03:25.060534 2008 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:25.060696 2008 heartbeater.cc:511] Master 127.1.55.254:38757 requested a full tablet report, sending...
I20260620 22:03:25.061156 1817 ts_manager.cc:194] Registered new tserver with Master: 1bbb74c9ecd141149899990477772a51 (127.1.55.193:43611)
I20260620 22:03:25.062052 1817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:42465
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:25.081624 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38757
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:41967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:25.154851 2013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:25.155025 2013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:25.155047 2013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:25.156061 2013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:25.156095 2013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:25.156121 2013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:25.157501 2013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:41967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:25.157667 2013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:25.157810 2013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:25.162026 2019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:25.162031 2018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:25.162187 2013 server_base.cc:1034] running on GCE node
W20260620 22:03:25.162074 2021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:25.162479 2013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:25.162695 2013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:25.163872 2013 hybrid_clock.cc:648] HybridClock initialized: now 1781993005163851 us; error 32 us; skew 500 ppm
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:25.166253 2013 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:25.166615 2013 webserver.cc:460] Webserver started at http://127.1.55.194:33811/ using document root <none> and password file <none>
I20260620 22:03:25.166842 2013 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:25.166908 2013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:25.167047 2013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:25.167989 2013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "a1268f39825c436e8533aa5831b2036d"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "5459e88c5c153608f226cbf01b7c7018"
server_key_iv: "0b3fe880666cc86f37765574688d0ada"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.168324 2013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "a1268f39825c436e8533aa5831b2036d"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "5459e88c5c153608f226cbf01b7c7018"
server_key_iv: "0b3fe880666cc86f37765574688d0ada"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.169550 2013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:25.170166 2028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.170329 2013 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:25.170413 2013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "a1268f39825c436e8533aa5831b2036d"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "5459e88c5c153608f226cbf01b7c7018"
server_key_iv: "0b3fe880666cc86f37765574688d0ada"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.170487 2013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:25.183692 2013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:25.185257 2013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:25.185397 2013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:25.185606 2013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:25.185878 2013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:25.185936 2013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.185973 2013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:25.186002 2013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.191265 2013 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:40949
I20260620 22:03:25.191308 2141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:40949 every 8 connection(s)
I20260620 22:03:25.191551 2013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:03:25.195247 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 2013
I20260620 22:03:25.195320 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:25.195478 1247 external_mini_cluster.cc:1428] Setting key 7e73c2a6763f1c22d80ce1da31565a32
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:25.200883 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.192204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:48293 (local address 127.1.55.254:38757)
0620 22:03:25.192286 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.192289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.192443 (+ 154us) server_negotiation.cc:407] Connection header received
0620 22:03:25.193318 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.193320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.193332 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.193383 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:25.193991 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.194490 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.195533 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.195851 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.195933 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.198123 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:25.198124 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:25.198124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:25.198131 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:25.199506 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.199966 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.199967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.199968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.200020 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.200273 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.200274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.200274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.200387 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:25.200466 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.200714 (+ 248us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.200794 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260620 22:03:25.201215 2144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.192134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38757 (local address 127.1.55.194:48293)
0620 22:03:25.192321 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:25.192360 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:25.193203 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:25.193450 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:25.193453 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:25.193731 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:25.193895 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.193899 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.194603 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.194604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.195433 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.195435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.195939 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.195940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.196069 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.196509 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:25.196516 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:25.198041 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:25.199592 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:25.199598 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:25.199600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:25.199895 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:25.200090 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:25.200091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:25.200091 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:25.200191 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:25.200458 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:25.200463 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:25.200592 (+ 129us) client_negotiation.cc:769] Sending connection context
0620 22:03:25.200694 (+ 102us) client_negotiation.cc:240] Negotiation successful
0620 22:03:25.200827 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260620 22:03:25.201840 2142 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38757
I20260620 22:03:25.201910 2142 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:25.202081 2142 heartbeater.cc:511] Master 127.1.55.254:38757 requested a full tablet report, sending...
I20260620 22:03:25.202432 1817 ts_manager.cc:194] Registered new tserver with Master: a1268f39825c436e8533aa5831b2036d (127.1.55.194:40949)
I20260620 22:03:25.202888 1817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:48293
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:25.218276 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38757
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:41967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:25.291389 2147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:25.291565 2147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:25.291586 2147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:25.293042 2147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:25.293080 2147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:25.293104 2147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:25.294562 2147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:41967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38757
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:25.294775 2147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:25.294973 2147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:25.299438 2152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:25.299477 2155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:25.299487 2153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:25.299743 2147 server_base.cc:1034] running on GCE node
I20260620 22:03:25.299921 2147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:25.300114 2147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:25.301235 2147 hybrid_clock.cc:648] HybridClock initialized: now 1781993005301224 us; error 25 us; skew 500 ppm
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:25.303606 2147 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:25.304020 2147 webserver.cc:460] Webserver started at http://127.1.55.195:44413/ using document root <none> and password file <none>
I20260620 22:03:25.304180 2147 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:25.304219 2147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:25.304298 2147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:25.305186 2147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "09811e767fb1461bb78ce9f020312c1d"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "f4422c03dd40f8a493223740f20020ae"
server_key_iv: "081d5e965bf574e7e8b06a070fc26817"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.305586 2147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "09811e767fb1461bb78ce9f020312c1d"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "f4422c03dd40f8a493223740f20020ae"
server_key_iv: "081d5e965bf574e7e8b06a070fc26817"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.306674 2147 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:25.307276 2162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.307484 2147 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:25.307578 2147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "09811e767fb1461bb78ce9f020312c1d"
format_stamp: "Formatted at 2026-06-20 22:03:25 on dist-test-slave-xw35"
server_key: "f4422c03dd40f8a493223740f20020ae"
server_key_iv: "081d5e965bf574e7e8b06a070fc26817"
server_key_version: "encryptionkey@0"
I20260620 22:03:25.307657 2147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:25.327301 2147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:25.329444 2147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:25.329597 2147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:25.329813 2147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:25.330091 2147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:25.330139 2147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.330178 2147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:25.330202 2147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:25.335532 2147 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:34673
I20260620 22:03:25.335573 2275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:34673 every 8 connection(s)
I20260620 22:03:25.335876 2147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:25.342082 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 2147
I20260620 22:03:25.342175 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:25.342396 1247 external_mini_cluster.cc:1428] Setting key de680629f76ad28eb9081d6ad82a0a84
I20260620 22:03:25.344446 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.336488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:52709 (local address 127.1.55.254:38757)
0620 22:03:25.336545 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.336547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.336703 (+ 156us) server_negotiation.cc:407] Connection header received
0620 22:03:25.337615 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.337616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.337626 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.337687 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:25.338182 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.338620 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.339554 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.339714 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.339758 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.341668 (+ 1910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:25.341669 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:25.341669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:25.341675 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:25.343173 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.343713 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.343714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.343715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.343795 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.344009 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.344010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.344010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.344108 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:25.344158 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.344328 (+ 170us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.344383 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:03:25.344643 2278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.336457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38757 (local address 127.1.55.195:52709)
0620 22:03:25.336589 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:25.336622 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:25.337522 (+ 900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:25.337733 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:25.337735 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:25.337934 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:25.338084 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.338088 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.338775 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.338776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.339486 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.339488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.339775 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.339776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.339878 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.340355 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:25.340362 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:25.341599 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:25.343265 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:25.343272 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:25.343273 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:25.343608 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:25.343865 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:25.343865 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:25.343866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:25.343954 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:25.344150 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:25.344153 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:25.344243 (+ 90us) client_negotiation.cc:769] Sending connection context
0620 22:03:25.344315 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 22:03:25.344415 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":78,"threads_started":1}
I20260620 22:03:25.345018 2276 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38757
I20260620 22:03:25.345096 2276 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:25.345240 2276 heartbeater.cc:511] Master 127.1.55.254:38757 requested a full tablet report, sending...
I20260620 22:03:25.345577 1817 ts_manager.cc:194] Registered new tserver with Master: 09811e767fb1461bb78ce9f020312c1d (127.1.55.195:34673)
I20260620 22:03:25.345908 1817 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:52709
I20260620 22:03:25.353927 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:03:25.361068 1868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.355410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41378 (local address 127.1.55.254:38757)
0620 22:03:25.355473 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.355475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.355547 (+ 72us) server_negotiation.cc:407] Connection header received
0620 22:03:25.355616 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.355617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.355626 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.355668 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:25.356214 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.356628 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.357323 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.357598 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.357685 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.358753 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:25.358754 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:25.358755 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:25.358760 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:25.360005 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.360320 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.360321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.360321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.360368 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.360564 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.360564 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.360564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.360690 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:25.360790 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.360901 (+ 111us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.360979 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 22:03:25.363034 1817 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:25.364573 1817 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:25.369771 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.366473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:34673 (local address 127.0.0.1:38094)
0620 22:03:25.366686 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:25.366720 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:25.366776 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:25.366983 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:25.366985 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:25.366988 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:25.367042 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.367043 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.367995 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.367996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.368738 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.368740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.369333 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.369334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.369423 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.369517 (+ 94us) client_negotiation.cc:769] Sending connection context
0620 22:03:25.369643 (+ 126us) client_negotiation.cc:240] Negotiation successful
0620 22:03:25.369699 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":53,"threads_started":1}
I20260620 22:03:25.370024 2287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.366646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38094 (local address 127.1.55.195:34673)
0620 22:03:25.366846 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.366850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.366858 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:03:25.366890 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.366892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.366901 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.366979 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:25.367136 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.367908 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.368835 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.369242 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.369328 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.369376 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.369920 (+ 544us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.369955 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":73,"threads_started":1}
I20260620 22:03:25.370520 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.366517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:40949 (local address 127.0.0.1:56740)
0620 22:03:25.366862 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:25.366871 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:25.366927 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:25.367099 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:25.367099 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:25.367101 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:25.367134 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.367135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.368367 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.368368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.369433 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.369435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.370321 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.370322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.370376 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.370382 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 22:03:25.370431 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:03:25.370466 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":2,"thread_start_us":43,"threads_started":1}
I20260620 22:03:25.370564 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.366678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56740 (local address 127.1.55.194:40949)
0620 22:03:25.366823 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.366865 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.366914 (+ 49us) server_negotiation.cc:407] Connection header received
0620 22:03:25.367001 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.367003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.367017 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.367094 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:25.367191 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.368265 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.369548 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.370192 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.370252 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.370291 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.370455 (+ 164us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.370490 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":78,"threads_started":1}
I20260620 22:03:25.370572 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.366653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45548 (local address 127.1.55.193:43611)
0620 22:03:25.366818 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.366822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.367065 (+ 243us) server_negotiation.cc:407] Connection header received
0620 22:03:25.367169 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.367171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.367185 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.367231 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:25.367483 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.368445 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.369614 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.370194 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.370236 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.370280 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.370469 (+ 189us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.370501 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":68,"threads_started":1}
I20260620 22:03:25.370524 2210 tablet_service.cc:1467] Processing CreateTablet for tablet 88a8dcd02fd84d2a93f83938ca9b90bc (DEFAULT_TABLE table=test-table [id=a46ea3c2fb354d28b233fbb131eb7c70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:25.370731 2286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.366543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:43611 (local address 127.0.0.1:45548)
0620 22:03:25.367014 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:25.367022 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:25.367088 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:25.367327 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:25.367327 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:25.367329 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:25.367380 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.367382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.368546 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.368547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.369538 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.369540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.370327 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.370327 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.370376 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.370382 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 22:03:25.370652 (+ 270us) client_negotiation.cc:240] Negotiation successful
0620 22:03:25.370686 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"mutex_wait_us":3,"thread_start_us":59,"threads_started":1}
I20260620 22:03:25.370792 2210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a8dcd02fd84d2a93f83938ca9b90bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:25.371095 2076 tablet_service.cc:1467] Processing CreateTablet for tablet 88a8dcd02fd84d2a93f83938ca9b90bc (DEFAULT_TABLE table=test-table [id=a46ea3c2fb354d28b233fbb131eb7c70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:25.371305 2076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a8dcd02fd84d2a93f83938ca9b90bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:25.371326 1942 tablet_service.cc:1467] Processing CreateTablet for tablet 88a8dcd02fd84d2a93f83938ca9b90bc (DEFAULT_TABLE table=test-table [id=a46ea3c2fb354d28b233fbb131eb7c70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:25.371579 1942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a8dcd02fd84d2a93f83938ca9b90bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:25.373642 2290 tablet_bootstrap.cc:492] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d: Bootstrap starting.
I20260620 22:03:25.374315 2290 tablet_bootstrap.cc:654] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:25.374385 2291 tablet_bootstrap.cc:492] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d: Bootstrap starting.
I20260620 22:03:25.374909 2290 log.cc:824] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:25.374989 2291 tablet_bootstrap.cc:654] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:25.375124 2292 tablet_bootstrap.cc:492] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51: Bootstrap starting.
I20260620 22:03:25.375432 2291 log.cc:824] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:25.375626 2292 tablet_bootstrap.cc:654] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:25.376063 2291 tablet_bootstrap.cc:492] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d: No bootstrap required, opened a new log
I20260620 22:03:25.376066 2292 log.cc:824] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:25.376137 2291 ts_tablet_manager.cc:1397] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:25.376742 2292 tablet_bootstrap.cc:492] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51: No bootstrap required, opened a new log
I20260620 22:03:25.376811 2292 ts_tablet_manager.cc:1397] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:25.377626 2291 raft_consensus.cc:348] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.377781 2291 raft_consensus.cc:374] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:25.377815 2291 raft_consensus.cc:729] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09811e767fb1461bb78ce9f020312c1d, State: Initialized, Role: FOLLOWER
I20260620 22:03:25.377832 2290 tablet_bootstrap.cc:492] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d: No bootstrap required, opened a new log
I20260620 22:03:25.377877 2290 ts_tablet_manager.cc:1397] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260620 22:03:25.377918 2291 consensus_queue.cc:260] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.378158 2291 ts_tablet_manager.cc:1428] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:03:25.378284 2276 heartbeater.cc:503] Master 127.1.55.254:38757 was elected leader, sending a full tablet report...
I20260620 22:03:25.378228 2292 raft_consensus.cc:348] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.378400 2292 raft_consensus.cc:374] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:25.378439 2292 raft_consensus.cc:729] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bbb74c9ecd141149899990477772a51, State: Initialized, Role: FOLLOWER
I20260620 22:03:25.378546 2292 consensus_queue.cc:260] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.379202 2292 ts_tablet_manager.cc:1428] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:03:25.379305 2008 heartbeater.cc:503] Master 127.1.55.254:38757 was elected leader, sending a full tablet report...
I20260620 22:03:25.379798 2290 raft_consensus.cc:348] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.379966 2290 raft_consensus.cc:374] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:25.380008 2290 raft_consensus.cc:729] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1268f39825c436e8533aa5831b2036d, State: Initialized, Role: FOLLOWER
I20260620 22:03:25.380100 2290 consensus_queue.cc:260] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.380326 2290 ts_tablet_manager.cc:1428] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 22:03:25.380330 2142 heartbeater.cc:503] Master 127.1.55.254:38757 was elected leader, sending a full tablet report...
W20260620 22:03:25.442011 2143 tablet.cc:2369] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:03:25.452380 2298 raft_consensus.cc:482] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:25.452448 2298 raft_consensus.cc:504] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.452728 2298 leader_election.cc:288] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09811e767fb1461bb78ce9f020312c1d (127.1.55.195:34673), 1bbb74c9ecd141149899990477772a51 (127.1.55.193:43611)
I20260620 22:03:25.455492 2144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.452886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:34673 (local address 127.1.55.194:59417)
0620 22:03:25.452931 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:25.452942 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:25.452977 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:25.453130 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:25.453131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:25.453132 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:25.453194 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.453195 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.453882 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.453883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.454676 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.454678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.455256 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.455257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.455325 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.455334 (+ 9us) client_negotiation.cc:769] Sending connection context
0620 22:03:25.455400 (+ 66us) client_negotiation.cc:240] Negotiation successful
0620 22:03:25.455435 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260620 22:03:25.455492 2287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.452927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:59417 (local address 127.1.55.195:34673)
0620 22:03:25.453003 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.453004 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.453022 (+ 18us) server_negotiation.cc:407] Connection header received
0620 22:03:25.453043 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.453044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.453060 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.453116 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:25.453254 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.453797 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.454787 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.455181 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.455258 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.455266 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.455406 (+ 140us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.455436 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260620 22:03:25.455602 2299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.452897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:43611 (local address 127.1.55.194:46201)
0620 22:03:25.453046 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:25.453062 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:25.453144 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:25.453273 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:25.453273 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:25.453275 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:25.453339 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.453341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.453962 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.453963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.454777 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:25.454779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.455366 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.455367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:25.455439 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.455442 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:25.455498 (+ 56us) client_negotiation.cc:240] Negotiation successful
0620 22:03:25.455533 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
I20260620 22:03:25.455595 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.452944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:46201 (local address 127.1.55.193:43611)
0620 22:03:25.452993 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.452995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.453130 (+ 135us) server_negotiation.cc:407] Connection header received
0620 22:03:25.453201 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.453202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.453211 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.453270 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:25.453401 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.453876 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.454862 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.455288 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.455366 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.455372 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.455514 (+ 142us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.455544 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 22:03:25.455771 2230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a8dcd02fd84d2a93f83938ca9b90bc" candidate_uuid: "a1268f39825c436e8533aa5831b2036d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09811e767fb1461bb78ce9f020312c1d" is_pre_election: true
I20260620 22:03:25.455902 2230 raft_consensus.cc:2454] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1268f39825c436e8533aa5831b2036d in term 0.
I20260620 22:03:25.456115 2029 leader_election.cc:302] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09811e767fb1461bb78ce9f020312c1d, a1268f39825c436e8533aa5831b2036d; no voters:
I20260620 22:03:25.456130 1962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a8dcd02fd84d2a93f83938ca9b90bc" candidate_uuid: "a1268f39825c436e8533aa5831b2036d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bbb74c9ecd141149899990477772a51" is_pre_election: true
I20260620 22:03:25.456221 2298 raft_consensus.cc:2781] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:25.456271 2298 raft_consensus.cc:482] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:25.456259 1962 raft_consensus.cc:2454] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1268f39825c436e8533aa5831b2036d in term 0.
I20260620 22:03:25.456296 2298 raft_consensus.cc:3037] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:25.456964 2298 raft_consensus.cc:504] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.457090 2298 leader_election.cc:288] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [CANDIDATE]: Term 1 election: Requested vote from peers 09811e767fb1461bb78ce9f020312c1d (127.1.55.195:34673), 1bbb74c9ecd141149899990477772a51 (127.1.55.193:43611)
I20260620 22:03:25.457242 1962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a8dcd02fd84d2a93f83938ca9b90bc" candidate_uuid: "a1268f39825c436e8533aa5831b2036d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bbb74c9ecd141149899990477772a51"
I20260620 22:03:25.457238 2230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a8dcd02fd84d2a93f83938ca9b90bc" candidate_uuid: "a1268f39825c436e8533aa5831b2036d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09811e767fb1461bb78ce9f020312c1d"
I20260620 22:03:25.457319 1962 raft_consensus.cc:3037] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:25.457316 2230 raft_consensus.cc:3037] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:25.457962 1962 raft_consensus.cc:2454] T 88a8dcd02fd84d2a93f83938ca9b90bc P 1bbb74c9ecd141149899990477772a51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1268f39825c436e8533aa5831b2036d in term 1.
I20260620 22:03:25.458086 2230 raft_consensus.cc:2454] T 88a8dcd02fd84d2a93f83938ca9b90bc P 09811e767fb1461bb78ce9f020312c1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1268f39825c436e8533aa5831b2036d in term 1.
I20260620 22:03:25.458148 2032 leader_election.cc:302] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bbb74c9ecd141149899990477772a51, a1268f39825c436e8533aa5831b2036d; no voters:
I20260620 22:03:25.458242 2298 raft_consensus.cc:2781] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:25.458374 2298 raft_consensus.cc:686] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [term 1 LEADER]: Becoming Leader. State: Replica: a1268f39825c436e8533aa5831b2036d, State: Running, Role: LEADER
I20260620 22:03:25.458456 2298 consensus_queue.cc:237] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } }
I20260620 22:03:25.459128 1817 catalog_manager.cc:5495] T 88a8dcd02fd84d2a93f83938ca9b90bc P a1268f39825c436e8533aa5831b2036d reported cstate change: term changed from 0 to 1, leader changed from <none> to a1268f39825c436e8533aa5831b2036d (127.1.55.194). New cstate: current_term: 1 leader_uuid: "a1268f39825c436e8533aa5831b2036d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09811e767fb1461bb78ce9f020312c1d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 34673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1268f39825c436e8533aa5831b2036d" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bbb74c9ecd141149899990477772a51" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 43611 } health_report { overall_health: UNKNOWN } } }
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:25.490379 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.483575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45564 (local address 127.1.55.193:43611)
0620 22:03:25.483643 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.483645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.483741 (+ 96us) server_negotiation.cc:407] Connection header received
0620 22:03:25.483813 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.483814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.483824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.483895 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:25.484406 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.484850 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.485488 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.485663 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.485729 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.487968 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:25.487976 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:25.487977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:25.487984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:25.489286 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.489669 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.489672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.489672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.489723 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.489905 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.489906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.489906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.490026 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:25.490158 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.490224 (+ 66us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.490293 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:25.510281 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.504331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45576 (local address 127.1.55.193:43611)
0620 22:03:25.504396 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.504402 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.504468 (+ 66us) server_negotiation.cc:407] Connection header received
0620 22:03:25.504503 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.504503 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.504512 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.504558 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:25.505029 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.505419 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.506165 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.506318 (+ 153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.506365 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.508301 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:25.508301 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:25.508302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:25.508307 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:25.509372 (+ 1065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.509689 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.509689 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.509690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.509731 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.509898 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.509898 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.509899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.509988 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:25.510060 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.510165 (+ 105us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.510214 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[1772](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:25.530191 2288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:25.524130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45578 (local address 127.1.55.193:43611)
0620 22:03:25.524194 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:25.524195 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:25.524255 (+ 60us) server_negotiation.cc:407] Connection header received
0620 22:03:25.524290 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:25.524291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:25.524298 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:25.524343 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:25.524856 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.525321 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.526040 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:25.526189 (+ 149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:25.526232 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:25.528145 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:25.528146 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:25.528146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:25.528151 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:25.529232 (+ 1081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.529590 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.529591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.529591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.529635 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:25.529794 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:25.529794 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:25.529794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:25.529867 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:25.529929 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:25.530045 (+ 116us) server_negotiation.cc:299] Negotiation successful
0620 22:03:25.530092 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260620 22:03:25.530622 1922 tablet_service.cc:2908] Rejecting scan request for tablet 88a8dcd02fd84d2a93f83938ca9b90bc: Uninitialized: clean time has not yet been initialized
I20260620 22:03:25.531535 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 1879
I20260620 22:03:25.535982 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 2013
I20260620 22:03:25.540411 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 2147
I20260620 22:03:25.544013 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 1785
2026-06-20T22:03:25Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (1841 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[2314](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[2314](info): set up 2 sockets
Jun 20 22:03:25 dist-test-slave-xw35 krb5kdc[2314](info): commencing operation
krb5kdc: starting...
W20260620 22:03:26.500846 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.936s user 0.000s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:26 dist-test-slave-xw35 krb5kdc[2314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:26.603788 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45753
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:26.676410 2327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:26.676608 2327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:26.676643 2327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:26.677721 2327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:26.677778 2327 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260620 22:03:26.677798 2327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:26.677825 2327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:26.677853 2327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:26.677876 2327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:26.679260 2327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45753
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:26.679517 2327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:26.679734 2327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:26.684127 2333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:26.684129 2332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:26.684201 2327 server_base.cc:1034] running on GCE node
W20260620 22:03:26.684108 2335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:26.684557 2327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:26.684819 2327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:26.685950 2327 hybrid_clock.cc:648] HybridClock initialized: now 1781993006685942 us; error 28 us; skew 500 ppm
Jun 20 22:03:26 dist-test-slave-xw35 krb5kdc[2314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993006, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:26.688167 2327 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:26.688540 2327 webserver.cc:460] Webserver started at http://127.1.55.254:45097/ using document root <none> and password file <none>
I20260620 22:03:26.688760 2327 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:26.688799 2327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:26.688927 2327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:26.689839 2327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "d177d3a3fc3e4271a701b30adc271e1a"
format_stamp: "Formatted at 2026-06-20 22:03:26 on dist-test-slave-xw35"
server_key: "bcb626c5692d5b688273ee9f7f37cc08"
server_key_iv: "6fb977d66c840a37d86f95eaea5a2517"
server_key_version: "encryptionkey@0"
I20260620 22:03:26.690141 2327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "d177d3a3fc3e4271a701b30adc271e1a"
format_stamp: "Formatted at 2026-06-20 22:03:26 on dist-test-slave-xw35"
server_key: "bcb626c5692d5b688273ee9f7f37cc08"
server_key_iv: "6fb977d66c840a37d86f95eaea5a2517"
server_key_version: "encryptionkey@0"
I20260620 22:03:26.691247 2327 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:26.691884 2342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:26.692067 2327 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:26.692149 2327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "d177d3a3fc3e4271a701b30adc271e1a"
format_stamp: "Formatted at 2026-06-20 22:03:26 on dist-test-slave-xw35"
server_key: "bcb626c5692d5b688273ee9f7f37cc08"
server_key_iv: "6fb977d66c840a37d86f95eaea5a2517"
server_key_version: "encryptionkey@0"
I20260620 22:03:26.692225 2327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:26.709837 2327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:26.711310 2327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:26.711440 2327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:26.715447 2327 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:45753
I20260620 22:03:26.715575 2404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:45753 every 8 connection(s)
I20260620 22:03:26.715793 2327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:26.716425 2405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:26.717854 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 2327
I20260620 22:03:26.717918 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:26.718070 1247 external_mini_cluster.cc:1428] Setting key 969c0cef43077142a859c4b5551de622
I20260620 22:03:26.718672 2405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a: Bootstrap starting.
I20260620 22:03:26.719259 2405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:26.719570 2405 log.cc:824] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:26.720180 2405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a: No bootstrap required, opened a new log
I20260620 22:03:26.721854 2405 raft_consensus.cc:348] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d177d3a3fc3e4271a701b30adc271e1a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45753 } }
I20260620 22:03:26.722005 2405 raft_consensus.cc:374] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:26.722047 2405 raft_consensus.cc:729] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d177d3a3fc3e4271a701b30adc271e1a, State: Initialized, Role: FOLLOWER
I20260620 22:03:26.722169 2405 consensus_queue.cc:260] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d177d3a3fc3e4271a701b30adc271e1a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45753 } }
I20260620 22:03:26.722257 2405 raft_consensus.cc:388] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:26.722289 2405 raft_consensus.cc:482] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:26.722337 2405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:26.722829 2405 raft_consensus.cc:504] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d177d3a3fc3e4271a701b30adc271e1a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45753 } }
I20260620 22:03:26.722913 2405 leader_election.cc:302] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d177d3a3fc3e4271a701b30adc271e1a; no voters:
I20260620 22:03:26.723112 2405 leader_election.cc:288] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:26.723137 2410 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:26.723251 2410 raft_consensus.cc:686] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [term 1 LEADER]: Becoming Leader. State: Replica: d177d3a3fc3e4271a701b30adc271e1a, State: Running, Role: LEADER
I20260620 22:03:26.723323 2410 consensus_queue.cc:237] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d177d3a3fc3e4271a701b30adc271e1a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45753 } }
I20260620 22:03:26.723368 2405 sys_catalog.cc:564] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:26.723589 2410 sys_catalog.cc:455] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d177d3a3fc3e4271a701b30adc271e1a. Latest consensus state: current_term: 1 leader_uuid: "d177d3a3fc3e4271a701b30adc271e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d177d3a3fc3e4271a701b30adc271e1a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45753 } } }
I20260620 22:03:26.723683 2410 sys_catalog.cc:458] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:26.723599 2411 sys_catalog.cc:455] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d177d3a3fc3e4271a701b30adc271e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d177d3a3fc3e4271a701b30adc271e1a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45753 } } }
I20260620 22:03:26.723856 2411 sys_catalog.cc:458] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:26.723896 2414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Jun 20 22:03:26 dist-test-slave-xw35 krb5kdc[2314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:26.724427 2414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:26.726416 2414 catalog_manager.cc:1347] Generated new cluster ID: d49029a35a9141adb775347bd6c9feaa
I20260620 22:03:26.726470 2414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:26.727973 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:26.718496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37538 (local address 127.1.55.254:45753)
0620 22:03:26.718667 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:26.718675 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:26.718704 (+ 29us) server_negotiation.cc:407] Connection header received
0620 22:03:26.719237 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:26.719245 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:26.719300 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:26.719443 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:26.719976 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.720806 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.721493 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.721887 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.722007 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:26.724549 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:26.724553 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:26.724553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:26.724566 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:26.726392 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:26.726776 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:26.726779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:26.726780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:26.726874 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:26.727079 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:26.727080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:26.727080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:26.727332 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:26.727499 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:26.727642 (+ 143us) server_negotiation.cc:299] Negotiation successful
0620 22:03:26.727768 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
I20260620 22:03:26.733321 2414 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:26.733820 2414 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:26.740542 2414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a: Generated new TSK 0
I20260620 22:03:26.740696 2414 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:26.775532 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45753
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:26.868544 2431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:26.868768 2431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:26.868805 2431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:26.870004 2431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:26.870061 2431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:26.870096 2431 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:03:26.870148 2431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:26.871935 2431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:26.872171 2431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:26.872365 2431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:26.876808 2437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:26.876849 2439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:26.876809 2436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:26.877066 2431 server_base.cc:1034] running on GCE node
I20260620 22:03:26.877274 2431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:26.877526 2431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:26.878684 2431 hybrid_clock.cc:648] HybridClock initialized: now 1781993006878671 us; error 34 us; skew 500 ppm
Jun 20 22:03:26 dist-test-slave-xw35 krb5kdc[2314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993006, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:26.881107 2431 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:26.881417 2431 webserver.cc:460] Webserver started at http://127.1.55.193:34259/ using document root <none> and password file <none>
I20260620 22:03:26.881636 2431 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:26.881700 2431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:26.881819 2431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:26.882710 2431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "d27c7f32677a4fae98a7437a953361f1"
format_stamp: "Formatted at 2026-06-20 22:03:26 on dist-test-slave-xw35"
server_key: "b715d9428d37848b09012ec99d1099c1"
server_key_iv: "b6e76d86b8fcf8e00268fe08df52d959"
server_key_version: "encryptionkey@0"
I20260620 22:03:26.883061 2431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "d27c7f32677a4fae98a7437a953361f1"
format_stamp: "Formatted at 2026-06-20 22:03:26 on dist-test-slave-xw35"
server_key: "b715d9428d37848b09012ec99d1099c1"
server_key_iv: "b6e76d86b8fcf8e00268fe08df52d959"
server_key_version: "encryptionkey@0"
I20260620 22:03:26.884315 2431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:26.885018 2446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:26.885176 2431 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:26.885263 2431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "d27c7f32677a4fae98a7437a953361f1"
format_stamp: "Formatted at 2026-06-20 22:03:26 on dist-test-slave-xw35"
server_key: "b715d9428d37848b09012ec99d1099c1"
server_key_iv: "b6e76d86b8fcf8e00268fe08df52d959"
server_key_version: "encryptionkey@0"
I20260620 22:03:26.885346 2431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:26.896710 2431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:26.898280 2431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:26.898415 2431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:26.898819 2431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:26.898876 2431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:26.898912 2431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:26.898937 2431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 22:03:26 dist-test-slave-xw35 krb5kdc[2314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993006, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:26.905440 2431 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:44059
I20260620 22:03:26.905572 2561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:44059 every 8 connection(s)
I20260620 22:03:26.905835 2431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:26.908196 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:26.899209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:47395 (local address 127.1.55.254:45753)
0620 22:03:26.899256 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:26.899258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:26.899428 (+ 170us) server_negotiation.cc:407] Connection header received
0620 22:03:26.899792 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:26.899793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:26.899805 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:26.899877 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:26.900558 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.901350 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.902939 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.903275 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.903345 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:26.905905 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:26.905906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:26.905906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:26.905913 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:26.907140 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:26.907500 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:26.907501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:26.907501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:26.907548 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:26.907749 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:26.907750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:26.907750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:26.907840 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:26.907888 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:26.908081 (+ 193us) server_negotiation.cc:299] Negotiation successful
0620 22:03:26.908137 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:03:26.908394 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:26.899200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45753 (local address 127.1.55.193:47395)
0620 22:03:26.899317 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:26.899349 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:26.899710 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:26.899915 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:26.899918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:26.900198 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:26.900445 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:26.900451 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.901463 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.901464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:26.902842 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:26.902845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.903382 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.903382 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:26.903547 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:26.904025 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:26.904035 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:26.905818 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:26.907205 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:26.907210 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:26.907212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:26.907438 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:26.907607 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:26.907607 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:26.907607 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:26.907696 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:26.907893 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:26.907897 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:26.907991 (+ 94us) client_negotiation.cc:769] Sending connection context
0620 22:03:26.908072 (+ 81us) client_negotiation.cc:240] Negotiation successful
0620 22:03:26.908173 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":64,"threads_started":1}
I20260620 22:03:26.908896 2562 heartbeater.cc:347] Connected to a master server at 127.1.55.254:45753
I20260620 22:03:26.908982 2562 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:26.909160 2562 heartbeater.cc:511] Master 127.1.55.254:45753 requested a full tablet report, sending...
I20260620 22:03:26.909662 2358 ts_manager.cc:194] Registered new tserver with Master: d27c7f32677a4fae98a7437a953361f1 (127.1.55.193:44059)
I20260620 22:03:26.909849 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 2431
I20260620 22:03:26.909940 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:26.910121 1247 external_mini_cluster.cc:1428] Setting key 9d3ff368a71daea1232b04e3b73ab3eb
I20260620 22:03:26.910483 2358 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:47395
I20260620 22:03:26.915567 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:26.909892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:35625 (local address 127.1.55.254:45753)
0620 22:03:26.909958 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:26.909960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:26.910208 (+ 248us) server_negotiation.cc:407] Connection header received
0620 22:03:26.910279 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:26.910280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:26.910288 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:26.910344 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:26.910646 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.911155 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.912128 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.912292 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.912345 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:26.913194 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:26.913195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:26.913196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:26.913202 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:26.914484 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:26.914852 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:26.914854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:26.914854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:26.914900 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:26.915091 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:26.915091 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:26.915092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:26.915186 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:26.915254 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:26.915415 (+ 161us) server_negotiation.cc:299] Negotiation successful
0620 22:03:26.915479 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260620 22:03:26.915575 2568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:26.910007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45753 (local address 127.1.55.193:35625)
0620 22:03:26.910145 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:26.910155 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:26.910230 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:26.910349 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:26.910350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:26.910523 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:26.910586 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:26.910588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.911254 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.911256 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:26.912049 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:26.912051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:26.912362 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:26.912363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:26.912441 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:26.912851 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:26.912855 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:26.913109 (+ 254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:26.914578 (+ 1469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:26.914579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:26.914579 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:26.914743 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:26.914969 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:26.914970 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:26.914970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:26.915026 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:26.915248 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:26.915249 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:26.915297 (+ 48us) client_negotiation.cc:769] Sending connection context
0620 22:03:26.915373 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 22:03:26.915481 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:26.933377 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45753
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:27.006800 2571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:27.006958 2571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:27.006978 2571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:27.008088 2571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:27.008126 2571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:27.008145 2571 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:03:27.008163 2571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:27.009784 2571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:27.009932 2571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:27.010092 2571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:27.014446 2579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:27.014467 2576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:27.014592 2577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:27.014833 2571 server_base.cc:1034] running on GCE node
I20260620 22:03:27.015034 2571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:27.015234 2571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:27.016376 2571 hybrid_clock.cc:648] HybridClock initialized: now 1781993007016358 us; error 27 us; skew 500 ppm
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993007, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:27.018682 2571 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:27.019049 2571 webserver.cc:460] Webserver started at http://127.1.55.194:37177/ using document root <none> and password file <none>
I20260620 22:03:27.019248 2571 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:27.019311 2571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:27.019450 2571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:27.020371 2571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "1cd42170b6b94e43b3ff8c532050e587"
format_stamp: "Formatted at 2026-06-20 22:03:27 on dist-test-slave-xw35"
server_key: "b50579ef1e07b5292ea4c51a5427686d"
server_key_iv: "03ab15ebac9bc26bb947f6056d4cabe3"
server_key_version: "encryptionkey@0"
I20260620 22:03:27.020704 2571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "1cd42170b6b94e43b3ff8c532050e587"
format_stamp: "Formatted at 2026-06-20 22:03:27 on dist-test-slave-xw35"
server_key: "b50579ef1e07b5292ea4c51a5427686d"
server_key_iv: "03ab15ebac9bc26bb947f6056d4cabe3"
server_key_version: "encryptionkey@0"
I20260620 22:03:27.021956 2571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:03:27.022617 2586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.022766 2571 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:27.022856 2571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "1cd42170b6b94e43b3ff8c532050e587"
format_stamp: "Formatted at 2026-06-20 22:03:27 on dist-test-slave-xw35"
server_key: "b50579ef1e07b5292ea4c51a5427686d"
server_key_iv: "03ab15ebac9bc26bb947f6056d4cabe3"
server_key_version: "encryptionkey@0"
I20260620 22:03:27.022930 2571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:27.040447 2571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:27.042446 2571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:27.042589 2571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:27.042976 2571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:27.043036 2571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.043073 2571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:27.043095 2571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993007, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:27.049794 2571 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:38803
I20260620 22:03:27.049844 2701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:38803 every 8 connection(s)
I20260620 22:03:27.050129 2571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:03:27.052641 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.043416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:51283 (local address 127.1.55.254:45753)
0620 22:03:27.043499 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.043502 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.043632 (+ 130us) server_negotiation.cc:407] Connection header received
0620 22:03:27.044063 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.044064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.044077 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.044151 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:27.044913 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.045681 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.046631 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.046825 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.046901 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.050023 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:27.050025 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:27.050025 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:27.050031 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:27.051382 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.051756 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.051758 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.051758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.051810 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.052047 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.052048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.052048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.052158 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:27.052229 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.052467 (+ 238us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.052559 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260620 22:03:27.052747 2595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.043378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45753 (local address 127.1.55.194:51283)
0620 22:03:27.043517 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.043550 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.043974 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.044209 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.044212 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.044537 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:27.044795 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.044801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.045766 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.045767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.046533 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.046535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.046910 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.046910 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.047022 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.047584 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:27.047595 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:27.049943 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:27.051469 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.051475 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.051477 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.051671 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.051880 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.051881 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.051881 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.051983 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.052220 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:27.052226 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:27.052345 (+ 119us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.052437 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.052565 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
I20260620 22:03:27.053146 2702 heartbeater.cc:347] Connected to a master server at 127.1.55.254:45753
I20260620 22:03:27.053220 2702 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:27.053371 2702 heartbeater.cc:511] Master 127.1.55.254:45753 requested a full tablet report, sending...
I20260620 22:03:27.053771 2358 ts_manager.cc:194] Registered new tserver with Master: 1cd42170b6b94e43b3ff8c532050e587 (127.1.55.194:38803)
I20260620 22:03:27.054244 2358 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:51283
I20260620 22:03:27.057281 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 2571
I20260620 22:03:27.057374 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:27.057580 1247 external_mini_cluster.cc:1428] Setting key 9f2f53c5342d9f03048eef307e0d4247
I20260620 22:03:27.058840 2708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.054038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45753 (local address 127.1.55.194:38435)
0620 22:03:27.054152 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.054161 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.054217 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.054339 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.054340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.054526 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:27.054593 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.054595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.055213 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.055214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.055674 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.055675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.056019 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.056020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.056093 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.056398 (+ 305us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:27.056401 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:27.056619 (+ 218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:27.058000 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.058000 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.058001 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.058203 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.058364 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.058365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.058365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.058406 (+ 41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.058657 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:27.058658 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:27.058686 (+ 28us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.058726 (+ 40us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.058783 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":64,"threads_started":1}
I20260620 22:03:27.058938 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.054094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:38435 (local address 127.1.55.254:45753)
0620 22:03:27.054132 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.054134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.054203 (+ 69us) server_negotiation.cc:407] Connection header received
0620 22:03:27.054271 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.054272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.054281 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.054335 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:27.054688 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.055130 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.055763 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.055944 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.056017 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.056707 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:27.056708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:27.056709 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:27.056714 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:27.057940 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.058248 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.058249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.058249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.058304 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.058439 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.058439 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.058440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.058600 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:27.058668 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.058752 (+ 84us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.058820 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:27.079671 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45753
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:27.151592 2711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:27.151736 2711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:27.151755 2711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:27.152872 2711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:27.152904 2711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:27.152922 2711 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:03:27.152972 2711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:27.154456 2711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:45753
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:27.154668 2711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:27.154889 2711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:27.158947 2716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:27.158947 2719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:27.159020 2717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:27.159096 2711 server_base.cc:1034] running on GCE node
I20260620 22:03:27.159265 2711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:27.159518 2711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:27.160643 2711 hybrid_clock.cc:648] HybridClock initialized: now 1781993007160635 us; error 24 us; skew 500 ppm
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993007, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:27.162663 2711 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:27.163025 2711 webserver.cc:460] Webserver started at http://127.1.55.195:38769/ using document root <none> and password file <none>
I20260620 22:03:27.163214 2711 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:27.163269 2711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:27.163391 2711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:27.164285 2711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "b4dcdb6b6b844de8bd478c86a876d858"
format_stamp: "Formatted at 2026-06-20 22:03:27 on dist-test-slave-xw35"
server_key: "907d5e3a6c437ed43f77353973864ac1"
server_key_iv: "4016f9b8634b117c137dd2b891ced956"
server_key_version: "encryptionkey@0"
I20260620 22:03:27.164613 2711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "b4dcdb6b6b844de8bd478c86a876d858"
format_stamp: "Formatted at 2026-06-20 22:03:27 on dist-test-slave-xw35"
server_key: "907d5e3a6c437ed43f77353973864ac1"
server_key_iv: "4016f9b8634b117c137dd2b891ced956"
server_key_version: "encryptionkey@0"
I20260620 22:03:27.165845 2711 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:27.166457 2726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.166617 2711 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:27.166697 2711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "b4dcdb6b6b844de8bd478c86a876d858"
format_stamp: "Formatted at 2026-06-20 22:03:27 on dist-test-slave-xw35"
server_key: "907d5e3a6c437ed43f77353973864ac1"
server_key_iv: "4016f9b8634b117c137dd2b891ced956"
server_key_version: "encryptionkey@0"
I20260620 22:03:27.166766 2711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:27.178472 2711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:27.179889 2711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:27.180025 2711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:27.180459 2711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:27.180514 2711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.180541 2711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:27.180567 2711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993007, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:27.186887 2711 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:39717
I20260620 22:03:27.187177 2711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:03:27.187181 2841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:39717 every 8 connection(s)
I20260620 22:03:27.189257 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.180832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:60217 (local address 127.1.55.254:45753)
0620 22:03:27.180906 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.180908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.181028 (+ 120us) server_negotiation.cc:407] Connection header received
0620 22:03:27.181368 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.181370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.181382 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.181444 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:27.182105 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.182817 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.183752 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.184096 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.184179 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.186674 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:27.186675 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:27.186675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:27.186681 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:27.188229 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.188576 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.188577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.188577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.188622 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.188851 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.188851 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.188852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.188934 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:27.188975 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.189147 (+ 172us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.189200 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260620 22:03:27.189388 2735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.180797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45753 (local address 127.1.55.195:60217)
0620 22:03:27.180914 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.180946 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.181287 (+ 341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.181553 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.181556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.181819 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:27.182011 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.182014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.182899 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.182900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.183659 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.183661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.184204 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.184205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.184360 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.184847 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:27.184861 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:27.186584 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:27.188293 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.188296 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.188297 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.188492 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.188672 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.188673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.188673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.188798 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.188968 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:27.188970 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:27.189054 (+ 84us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.189120 (+ 66us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.189213 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":65,"threads_started":1}
I20260620 22:03:27.189821 2842 heartbeater.cc:347] Connected to a master server at 127.1.55.254:45753
I20260620 22:03:27.189899 2842 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:27.190040 2842 heartbeater.cc:511] Master 127.1.55.254:45753 requested a full tablet report, sending...
I20260620 22:03:27.190313 2359 ts_manager.cc:194] Registered new tserver with Master: b4dcdb6b6b844de8bd478c86a876d858 (127.1.55.195:39717)
I20260620 22:03:27.190690 2359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:60217
I20260620 22:03:27.193650 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 2711
I20260620 22:03:27.193779 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:27.193950 1247 external_mini_cluster.cc:1428] Setting key ba577410466954fe155d1f1359ac60eb
I20260620 22:03:27.194865 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:03:27.195588 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.190648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:53415 (local address 127.1.55.254:45753)
0620 22:03:27.190675 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.190677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.190772 (+ 95us) server_negotiation.cc:407] Connection header received
0620 22:03:27.190809 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.190810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.190818 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.190864 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:27.191137 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.191513 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.192200 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.192360 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.192428 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.193120 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:27.193122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:27.193122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:27.193128 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:27.194643 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.195025 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.195026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.195026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.195076 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.195242 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.195243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.195243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.195321 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:27.195364 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.195500 (+ 136us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.195545 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:03:27.195708 2848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.190600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45753 (local address 127.1.55.195:53415)
0620 22:03:27.190701 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.190709 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.190763 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.190869 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.190870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.191021 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:27.191071 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.191072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.191593 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.191594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.192116 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.192118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.192431 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.192432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.192501 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.192793 (+ 292us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:27.192796 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:27.193001 (+ 205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:27.194751 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.194752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.194753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.194974 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.195136 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.195136 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.195137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.195190 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.195375 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:27.195376 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:27.195415 (+ 39us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.195485 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.195585 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":63,"threads_started":1}
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993007, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993007, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:27.224942 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.217906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37546 (local address 127.1.55.254:45753)
0620 22:03:27.217936 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.217939 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.217946 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:03:27.217966 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.217967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.217976 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.218034 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:27.218529 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.219239 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.220116 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.220421 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.220513 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.222410 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:27.222411 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:27.222411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:27.222417 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:27.224001 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.224291 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.224292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.224292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.224337 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.224499 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.224500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.224500 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.224597 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:27.224696 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.224785 (+ 89us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.224836 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:03:27.226253 2359 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37546:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:27.227736 2359 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:27.233573 2860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.229879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55292 (local address 127.1.55.195:39717)
0620 22:03:27.230027 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.230031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.230130 (+ 99us) server_negotiation.cc:407] Connection header received
0620 22:03:27.230173 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.230175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.230189 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.230262 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.230383 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.231398 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.232472 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.233125 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.233186 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.233231 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.233424 (+ 193us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.233461 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260620 22:03:27.233569 2858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.229887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:38803 (local address 127.0.0.1:44600)
0620 22:03:27.230148 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.230158 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.230203 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.230595 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.230596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.230598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.230630 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.230632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.231463 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.231464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.232738 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.232740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.233300 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.233301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.233356 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.233360 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.233409 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.233493 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":32,"thread_start_us":34,"threads_started":1}
I20260620 22:03:27.233826 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.230033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44600 (local address 127.1.55.194:38803)
0620 22:03:27.230369 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.230373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.230382 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:27.230421 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.230423 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.230434 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.230528 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.230704 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.231377 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.232796 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.233220 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.233299 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.233346 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.233685 (+ 339us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.233739 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":62,"threads_started":1}
I20260620 22:03:27.233896 2857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.229702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57096 (local address 127.1.55.193:44059)
0620 22:03:27.229868 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.229872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.229882 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:03:27.229921 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.229924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.229938 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.230035 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.230301 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.231388 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.232743 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.233365 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.233419 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.233463 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.233751 (+ 288us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.233789 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":62,"threads_started":1}
I20260620 22:03:27.233711 2859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.229780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:39717 (local address 127.0.0.1:55292)
0620 22:03:27.230042 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.230052 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.230113 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.230272 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.230273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.230275 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.230316 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.230317 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.231488 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.231489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.232359 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.232383 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.233263 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.233264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.233335 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.233346 (+ 11us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.233412 (+ 66us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.233565 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":130,"thread_start_us":29,"threads_started":1}
I20260620 22:03:27.233798 2856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.229605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:44059 (local address 127.0.0.1:57096)
0620 22:03:27.229691 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.229715 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.229763 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.230169 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.230171 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.230174 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.230223 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.230224 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.231488 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.231489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.232667 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.232670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.233545 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.233546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.233598 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.233602 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.233650 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.233698 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":82,"thread_start_us":54,"threads_started":1}
I20260620 22:03:27.234501 2636 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfb4127494c4ca38b1f9828fcab924d (DEFAULT_TABLE table=test-table [id=5a8095a791174576980199a617ebcf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:27.234702 2763 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfb4127494c4ca38b1f9828fcab924d (DEFAULT_TABLE table=test-table [id=5a8095a791174576980199a617ebcf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:27.234869 2636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfb4127494c4ca38b1f9828fcab924d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.234922 2496 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfb4127494c4ca38b1f9828fcab924d (DEFAULT_TABLE table=test-table [id=5a8095a791174576980199a617ebcf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:27.235023 2763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfb4127494c4ca38b1f9828fcab924d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.235179 2496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfb4127494c4ca38b1f9828fcab924d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.237047 2862 tablet_bootstrap.cc:492] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: Bootstrap starting.
I20260620 22:03:27.237887 2862 tablet_bootstrap.cc:654] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.238210 2862 log.cc:824] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:27.238384 2863 tablet_bootstrap.cc:492] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: Bootstrap starting.
I20260620 22:03:27.238593 2864 tablet_bootstrap.cc:492] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: Bootstrap starting.
I20260620 22:03:27.239004 2862 tablet_bootstrap.cc:492] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: No bootstrap required, opened a new log
I20260620 22:03:27.239063 2863 tablet_bootstrap.cc:654] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.239081 2862 ts_tablet_manager.cc:1397] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 22:03:27.239123 2864 tablet_bootstrap.cc:654] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.239365 2864 log.cc:824] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:27.239357 2863 log.cc:824] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:27.239969 2864 tablet_bootstrap.cc:492] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: No bootstrap required, opened a new log
I20260620 22:03:27.240052 2864 ts_tablet_manager.cc:1397] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:27.240095 2863 tablet_bootstrap.cc:492] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: No bootstrap required, opened a new log
I20260620 22:03:27.240156 2863 ts_tablet_manager.cc:1397] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:27.240957 2862 raft_consensus.cc:348] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.241122 2862 raft_consensus.cc:374] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.241163 2862 raft_consensus.cc:729] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4dcdb6b6b844de8bd478c86a876d858, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.241266 2862 consensus_queue.cc:260] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.241362 2864 raft_consensus.cc:348] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.241518 2862 ts_tablet_manager.cc:1428] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260620 22:03:27.241544 2864 raft_consensus.cc:374] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.241591 2864 raft_consensus.cc:729] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27c7f32677a4fae98a7437a953361f1, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.241706 2864 consensus_queue.cc:260] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.241921 2864 ts_tablet_manager.cc:1428] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:03:27.241990 2562 heartbeater.cc:503] Master 127.1.55.254:45753 was elected leader, sending a full tablet report...
I20260620 22:03:27.242022 2842 heartbeater.cc:503] Master 127.1.55.254:45753 was elected leader, sending a full tablet report...
I20260620 22:03:27.242942 2863 raft_consensus.cc:348] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.243077 2863 raft_consensus.cc:374] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.243098 2863 raft_consensus.cc:729] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cd42170b6b94e43b3ff8c532050e587, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.243158 2863 consensus_queue.cc:260] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.243315 2863 ts_tablet_manager.cc:1428] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:03:27.243383 2702 heartbeater.cc:503] Master 127.1.55.254:45753 was elected leader, sending a full tablet report...
I20260620 22:03:27.275130 2868 raft_consensus.cc:482] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:27.275187 2868 raft_consensus.cc:504] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.275465 2868 leader_election.cc:288] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d27c7f32677a4fae98a7437a953361f1 (127.1.55.193:44059), 1cd42170b6b94e43b3ff8c532050e587 (127.1.55.194:38803)
I20260620 22:03:27.278152 2735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.275630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:44059 (local address 127.1.55.195:45537)
0620 22:03:27.275698 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.275710 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.275754 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.275871 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.275872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.275873 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.275946 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.275947 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.276636 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.276637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.277373 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.277375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.277916 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.277917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.277991 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.277995 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.278050 (+ 55us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.278078 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":19}
I20260620 22:03:27.278169 2857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.275719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:45537 (local address 127.1.55.193:44059)
0620 22:03:27.275756 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.275758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.275766 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:03:27.275809 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.275810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.275819 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.275867 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.276057 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.276529 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.277462 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.277842 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.277892 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.277897 (+ 5us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.278070 (+ 173us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.278109 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:03:27.278245 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.275796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:47657 (local address 127.1.55.194:38803)
0620 22:03:27.275835 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.275836 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.275929 (+ 93us) server_negotiation.cc:407] Connection header received
0620 22:03:27.275952 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.275953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.275963 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.276030 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.276175 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.276583 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.277537 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.277890 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.277960 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.277967 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.278145 (+ 178us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.278182 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:03:27.278273 2871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.275740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:38803 (local address 127.1.55.195:47657)
0620 22:03:27.275863 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.275872 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.275917 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.276049 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.276050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.276052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.276112 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.276113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.276692 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.276693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.277391 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.277393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.277984 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.277984 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.278071 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.278075 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.278128 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.278162 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
I20260620 22:03:27.278497 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfb4127494c4ca38b1f9828fcab924d" candidate_uuid: "b4dcdb6b6b844de8bd478c86a876d858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27c7f32677a4fae98a7437a953361f1" is_pre_election: true
I20260620 22:03:27.278514 2656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfb4127494c4ca38b1f9828fcab924d" candidate_uuid: "b4dcdb6b6b844de8bd478c86a876d858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cd42170b6b94e43b3ff8c532050e587" is_pre_election: true
I20260620 22:03:27.278637 2516 raft_consensus.cc:2454] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4dcdb6b6b844de8bd478c86a876d858 in term 0.
I20260620 22:03:27.278647 2656 raft_consensus.cc:2454] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4dcdb6b6b844de8bd478c86a876d858 in term 0.
I20260620 22:03:27.278851 2728 leader_election.cc:302] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cd42170b6b94e43b3ff8c532050e587, b4dcdb6b6b844de8bd478c86a876d858; no voters:
I20260620 22:03:27.278985 2868 raft_consensus.cc:2781] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:27.279039 2868 raft_consensus.cc:482] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:27.279062 2868 raft_consensus.cc:3037] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.279589 2868 raft_consensus.cc:504] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.279703 2868 leader_election.cc:288] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [CANDIDATE]: Term 1 election: Requested vote from peers d27c7f32677a4fae98a7437a953361f1 (127.1.55.193:44059), 1cd42170b6b94e43b3ff8c532050e587 (127.1.55.194:38803)
I20260620 22:03:27.279851 2656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfb4127494c4ca38b1f9828fcab924d" candidate_uuid: "b4dcdb6b6b844de8bd478c86a876d858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cd42170b6b94e43b3ff8c532050e587"
I20260620 22:03:27.279917 2656 raft_consensus.cc:3037] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.280501 2656 raft_consensus.cc:2454] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4dcdb6b6b844de8bd478c86a876d858 in term 1.
I20260620 22:03:27.280608 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfb4127494c4ca38b1f9828fcab924d" candidate_uuid: "b4dcdb6b6b844de8bd478c86a876d858" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27c7f32677a4fae98a7437a953361f1"
I20260620 22:03:27.280678 2516 raft_consensus.cc:3037] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.280684 2728 leader_election.cc:302] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cd42170b6b94e43b3ff8c532050e587, b4dcdb6b6b844de8bd478c86a876d858; no voters:
I20260620 22:03:27.280761 2868 raft_consensus.cc:2781] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:27.280896 2868 raft_consensus.cc:686] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 1 LEADER]: Becoming Leader. State: Replica: b4dcdb6b6b844de8bd478c86a876d858, State: Running, Role: LEADER
I20260620 22:03:27.280995 2868 consensus_queue.cc:237] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } }
I20260620 22:03:27.281422 2516 raft_consensus.cc:2454] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4dcdb6b6b844de8bd478c86a876d858 in term 1.
I20260620 22:03:27.281659 2359 catalog_manager.cc:5495] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4dcdb6b6b844de8bd478c86a876d858 (127.1.55.195). New cstate: current_term: 1 leader_uuid: "b4dcdb6b6b844de8bd478c86a876d858" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } health_report { overall_health: UNKNOWN } } }
I20260620 22:03:27.290360 2860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.288027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55308 (local address 127.1.55.195:39717)
0620 22:03:27.288066 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.288068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.288077 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:27.288180 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.288181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.288196 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.288279 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:27.288415 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.288821 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.289638 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.289797 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.289864 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.290048 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:27.290145 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:27.290220 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.290268 (+ 48us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.290285 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:03:27.291872 2516 raft_consensus.cc:1261] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Refusing update from remote peer b4dcdb6b6b844de8bd478c86a876d858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:27.291872 2656 raft_consensus.cc:1261] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Refusing update from remote peer b4dcdb6b6b844de8bd478c86a876d858: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:27.292152 2868 consensus_queue.cc:1035] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:27.292258 2872 consensus_queue.cc:1035] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:27.294440 2875 mvcc.cc:205] Tried to move back new op lower bound from 7299043357865160704 to 7299043357823614976. Current Snapshot: MvccSnapshot[applied={T|T < 7299043357865160704}]
I20260620 22:03:27.294548 2877 mvcc.cc:205] Tried to move back new op lower bound from 7299043357865160704 to 7299043357823614976. Current Snapshot: MvccSnapshot[applied={T|T < 7299043357865160704}]
I20260620 22:03:27.295558 2876 mvcc.cc:205] Tried to move back new op lower bound from 7299043357865160704 to 7299043357823614976. Current Snapshot: MvccSnapshot[applied={T|T < 7299043357865160704}]
I20260620 22:03:27.297534 2359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37546:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:27.297605 2359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37546:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:27.298236 2359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a: Sending DeleteTablet for 3 replicas of tablet 2cfb4127494c4ca38b1f9828fcab924d
I20260620 22:03:27.298522 2763 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfb4127494c4ca38b1f9828fcab924d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:27 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:55292
I20260620 22:03:27.298592 2496 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfb4127494c4ca38b1f9828fcab924d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:27 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:57096
I20260620 22:03:27.298749 2636 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfb4127494c4ca38b1f9828fcab924d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:27 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:44600
I20260620 22:03:27.298754 2359 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37546:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:27.298863 2359 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:27.299057 2886 tablet_replica.cc:330] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: stopping tablet replica
I20260620 22:03:27.299144 2887 tablet_replica.cc:330] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: stopping tablet replica
I20260620 22:03:27.299151 2886 raft_consensus.cc:2229] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:27.299207 2887 raft_consensus.cc:2229] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:27.299237 2886 raft_consensus.cc:2258] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:27.299743 2886 ts_tablet_manager.cc:1905] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:27.300000 2763 tablet_service.cc:1467] Processing CreateTablet for tablet bdcfa1203cb245e0b1c6936338cc415a (DEFAULT_TABLE table=test-table [id=bc02921def54428aba8c3ec92d3eb0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:27.300099 2763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdcfa1203cb245e0b1c6936338cc415a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.300212 2496 tablet_service.cc:1467] Processing CreateTablet for tablet bdcfa1203cb245e0b1c6936338cc415a (DEFAULT_TABLE table=test-table [id=bc02921def54428aba8c3ec92d3eb0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:27.300302 2496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdcfa1203cb245e0b1c6936338cc415a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.301154 2886 ts_tablet_manager.cc:1918] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:27.301209 2886 log.cc:1196] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/2cfb4127494c4ca38b1f9828fcab924d
I20260620 22:03:27.301299 2862 tablet_bootstrap.cc:492] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: Bootstrap starting.
I20260620 22:03:27.301440 2886 ts_tablet_manager.cc:1939] T 2cfb4127494c4ca38b1f9828fcab924d P d27c7f32677a4fae98a7437a953361f1: Deleting consensus metadata
I20260620 22:03:27.301494 2864 tablet_bootstrap.cc:492] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: Bootstrap starting.
I20260620 22:03:27.301692 2862 tablet_bootstrap.cc:654] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.301849 2864 tablet_bootstrap.cc:654] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.302639 2862 tablet_bootstrap.cc:492] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: No bootstrap required, opened a new log
I20260620 22:03:27.302663 2344 catalog_manager.cc:4841] TS d27c7f32677a4fae98a7437a953361f1 (127.1.55.193:44059): tablet 2cfb4127494c4ca38b1f9828fcab924d (table test-table [id=5a8095a791174576980199a617ebcf72]) successfully deleted
I20260620 22:03:27.302687 2862 ts_tablet_manager.cc:1397] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:27.302841 2862 raft_consensus.cc:348] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.302922 2862 raft_consensus.cc:374] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.302928 2864 tablet_bootstrap.cc:492] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: No bootstrap required, opened a new log
I20260620 22:03:27.302947 2862 raft_consensus.cc:729] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4dcdb6b6b844de8bd478c86a876d858, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.302964 2864 ts_tablet_manager.cc:1397] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:27.303005 2862 consensus_queue.cc:260] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.303103 2862 ts_tablet_manager.cc:1428] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.303092 2864 raft_consensus.cc:348] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.303146 2864 raft_consensus.cc:374] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.303181 2864 raft_consensus.cc:729] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27c7f32677a4fae98a7437a953361f1, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.303227 2864 consensus_queue.cc:260] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.303319 2864 ts_tablet_manager.cc:1428] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.301438 2636 tablet_service.cc:1467] Processing CreateTablet for tablet bdcfa1203cb245e0b1c6936338cc415a (DEFAULT_TABLE table=test-table [id=bc02921def54428aba8c3ec92d3eb0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:27.303515 2636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdcfa1203cb245e0b1c6936338cc415a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.304555 2863 tablet_bootstrap.cc:492] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: Bootstrap starting.
I20260620 22:03:27.299284 2887 raft_consensus.cc:2258] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:27.304864 2885 tablet_replica.cc:330] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: stopping tablet replica
I20260620 22:03:27.304944 2863 tablet_bootstrap.cc:654] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.304955 2885 raft_consensus.cc:2229] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:03:27.305011 2885 raft_consensus.cc:2258] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:27.305387 2887 ts_tablet_manager.cc:1905] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:27.305626 2863 tablet_bootstrap.cc:492] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: No bootstrap required, opened a new log
I20260620 22:03:27.305670 2863 ts_tablet_manager.cc:1397] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:27.305783 2863 raft_consensus.cc:348] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.305835 2863 raft_consensus.cc:374] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.305853 2863 raft_consensus.cc:729] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cd42170b6b94e43b3ff8c532050e587, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.305897 2863 consensus_queue.cc:260] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.305964 2863 ts_tablet_manager.cc:1428] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.306571 2887 ts_tablet_manager.cc:1918] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:27.306630 2887 log.cc:1196] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/2cfb4127494c4ca38b1f9828fcab924d
I20260620 22:03:27.306854 2887 ts_tablet_manager.cc:1939] T 2cfb4127494c4ca38b1f9828fcab924d P 1cd42170b6b94e43b3ff8c532050e587: Deleting consensus metadata
I20260620 22:03:27.307184 2344 catalog_manager.cc:4841] TS 1cd42170b6b94e43b3ff8c532050e587 (127.1.55.194:38803): tablet 2cfb4127494c4ca38b1f9828fcab924d (table test-table [id=5a8095a791174576980199a617ebcf72]) successfully deleted
I20260620 22:03:27.307410 2885 ts_tablet_manager.cc:1905] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:27.308619 2885 ts_tablet_manager.cc:1918] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:27.308679 2885 log.cc:1196] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/2cfb4127494c4ca38b1f9828fcab924d
I20260620 22:03:27.308830 2885 ts_tablet_manager.cc:1939] T 2cfb4127494c4ca38b1f9828fcab924d P b4dcdb6b6b844de8bd478c86a876d858: Deleting consensus metadata
I20260620 22:03:27.309158 2344 catalog_manager.cc:4841] TS b4dcdb6b6b844de8bd478c86a876d858 (127.1.55.195:39717): tablet 2cfb4127494c4ca38b1f9828fcab924d (table test-table [id=5a8095a791174576980199a617ebcf72]) successfully deleted
W20260620 22:03:27.406705 2563 tablet.cc:2369] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:03:27.437988 2843 tablet.cc:2369] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:03:27.471874 2869 raft_consensus.cc:482] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:27.471962 2869 raft_consensus.cc:504] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.472260 2869 leader_election.cc:288] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cd42170b6b94e43b3ff8c532050e587 (127.1.55.194:38803), b4dcdb6b6b844de8bd478c86a876d858 (127.1.55.195:39717)
I20260620 22:03:27.475097 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.472519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:37049 (local address 127.1.55.194:38803)
0620 22:03:27.472572 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.472574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.472610 (+ 36us) server_negotiation.cc:407] Connection header received
0620 22:03:27.472704 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.472706 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.472716 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.472745 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.472978 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.473398 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.474393 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.474748 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.474802 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.474808 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.474994 (+ 186us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.475038 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 22:03:27.475106 2891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.472433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:38803 (local address 127.1.55.193:37049)
0620 22:03:27.472552 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.472563 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.472622 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.472812 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.472813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.472815 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.472885 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.472889 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.473516 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.473517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.474312 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.474314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.474842 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.474843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.474929 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.474933 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.474982 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.475009 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"mutex_wait_us":36,"thread_start_us":66,"threads_started":1}
I20260620 22:03:27.475172 2860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.472667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:49735 (local address 127.1.55.195:39717)
0620 22:03:27.472716 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.472718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.472737 (+ 19us) server_negotiation.cc:407] Connection header received
0620 22:03:27.472790 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.472791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.472800 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.472843 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.472959 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.473386 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.474444 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.474832 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.474914 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.474922 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.475078 (+ 156us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.475113 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260620 22:03:27.475407 2892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.472605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:39717 (local address 127.1.55.193:49735)
0620 22:03:27.472684 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.472693 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.472743 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.472845 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.472846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.472848 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.472896 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.472898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.473465 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.473466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.474325 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.474327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.474927 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.474928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.475000 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.475003 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.475052 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.475086 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"thread_start_us":35,"threads_started":1}
I20260620 22:03:27.475436 2656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdcfa1203cb245e0b1c6936338cc415a" candidate_uuid: "d27c7f32677a4fae98a7437a953361f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cd42170b6b94e43b3ff8c532050e587" is_pre_election: true
I20260620 22:03:27.475540 2656 raft_consensus.cc:2454] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27c7f32677a4fae98a7437a953361f1 in term 0.
I20260620 22:03:27.475620 2796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdcfa1203cb245e0b1c6936338cc415a" candidate_uuid: "d27c7f32677a4fae98a7437a953361f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4dcdb6b6b844de8bd478c86a876d858" is_pre_election: true
I20260620 22:03:27.475719 2796 raft_consensus.cc:2454] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d27c7f32677a4fae98a7437a953361f1 in term 0.
I20260620 22:03:27.475706 2448 leader_election.cc:302] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cd42170b6b94e43b3ff8c532050e587, d27c7f32677a4fae98a7437a953361f1; no voters:
I20260620 22:03:27.475833 2869 raft_consensus.cc:2781] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:27.475879 2869 raft_consensus.cc:482] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:27.475903 2869 raft_consensus.cc:3037] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.476511 2869 raft_consensus.cc:504] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.476676 2869 leader_election.cc:288] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [CANDIDATE]: Term 1 election: Requested vote from peers 1cd42170b6b94e43b3ff8c532050e587 (127.1.55.194:38803), b4dcdb6b6b844de8bd478c86a876d858 (127.1.55.195:39717)
I20260620 22:03:27.476819 2656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdcfa1203cb245e0b1c6936338cc415a" candidate_uuid: "d27c7f32677a4fae98a7437a953361f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cd42170b6b94e43b3ff8c532050e587"
I20260620 22:03:27.476903 2656 raft_consensus.cc:3037] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.476868 2796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdcfa1203cb245e0b1c6936338cc415a" candidate_uuid: "d27c7f32677a4fae98a7437a953361f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4dcdb6b6b844de8bd478c86a876d858"
I20260620 22:03:27.476969 2796 raft_consensus.cc:3037] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.477455 2656 raft_consensus.cc:2454] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27c7f32677a4fae98a7437a953361f1 in term 1.
I20260620 22:03:27.477634 2448 leader_election.cc:302] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cd42170b6b94e43b3ff8c532050e587, d27c7f32677a4fae98a7437a953361f1; no voters:
I20260620 22:03:27.477684 2796 raft_consensus.cc:2454] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d27c7f32677a4fae98a7437a953361f1 in term 1.
I20260620 22:03:27.477778 2869 raft_consensus.cc:2781] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:27.477924 2869 raft_consensus.cc:686] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 1 LEADER]: Becoming Leader. State: Replica: d27c7f32677a4fae98a7437a953361f1, State: Running, Role: LEADER
I20260620 22:03:27.477993 2869 consensus_queue.cc:237] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.478627 2358 catalog_manager.cc:5495] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to d27c7f32677a4fae98a7437a953361f1 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "d27c7f32677a4fae98a7437a953361f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } health_report { overall_health: UNKNOWN } } }
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993006, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:27.504001 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.498079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37558 (local address 127.1.55.254:45753)
0620 22:03:27.498142 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.498144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.498234 (+ 90us) server_negotiation.cc:407] Connection header received
0620 22:03:27.498296 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.498296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.498305 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.498363 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:27.498734 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.499112 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.499742 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.499900 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.499959 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.501890 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:27.501891 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:27.501892 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:27.501899 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:27.503126 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.503433 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.503433 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.503434 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.503475 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.503617 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.503617 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.503617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.503731 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:27.503774 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.503886 (+ 112us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.503946 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 22:03:27.504169 2900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.498017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45753 (local address 127.0.0.1:37558)
0620 22:03:27.498171 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.498184 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.498248 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.498366 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.498367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.498631 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:27.498662 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.498664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.499182 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.499183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.499649 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.499651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.499969 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.499970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.500026 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.500469 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:27.500473 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:27.501774 (+ 1301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:27.503192 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.503197 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.503199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.503372 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.503527 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:27.503527 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:27.503528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:27.503582 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:27.503779 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:27.503784 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:27.503822 (+ 38us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.503872 (+ 50us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.504013 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":60,"thread_start_us":95,"threads_started":1}
I20260620 22:03:27.506017 2358 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:37558:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260620 22:03:27.506215 2358 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:27.507398 2496 tablet_service.cc:1467] Processing CreateTablet for tablet 1e48d95a45c44e21b2e9ceaec629a0dc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c7906f7585204bcd93be043182a93d2a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:03:27.507475 2763 tablet_service.cc:1467] Processing CreateTablet for tablet 1e48d95a45c44e21b2e9ceaec629a0dc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c7906f7585204bcd93be043182a93d2a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:03:27.507582 2763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e48d95a45c44e21b2e9ceaec629a0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.507582 2496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e48d95a45c44e21b2e9ceaec629a0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.508945 2862 tablet_bootstrap.cc:492] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: Bootstrap starting.
I20260620 22:03:27.508993 2636 tablet_service.cc:1467] Processing CreateTablet for tablet 1e48d95a45c44e21b2e9ceaec629a0dc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c7906f7585204bcd93be043182a93d2a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:03:27.509109 2636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e48d95a45c44e21b2e9ceaec629a0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:27.509238 2862 tablet_bootstrap.cc:654] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.509761 2862 tablet_bootstrap.cc:492] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: No bootstrap required, opened a new log
I20260620 22:03:27.509810 2862 ts_tablet_manager.cc:1397] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260620 22:03:27.509917 2862 raft_consensus.cc:348] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.509975 2862 raft_consensus.cc:374] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.509994 2862 raft_consensus.cc:729] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4dcdb6b6b844de8bd478c86a876d858, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.510036 2862 consensus_queue.cc:260] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.510135 2862 ts_tablet_manager.cc:1428] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.510169 2882 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.510255 2882 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:27.510432 2863 tablet_bootstrap.cc:492] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: Bootstrap starting.
I20260620 22:03:27.510471 2864 tablet_bootstrap.cc:492] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: Bootstrap starting.
I20260620 22:03:27.510797 2864 tablet_bootstrap.cc:654] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.510798 2863 tablet_bootstrap.cc:654] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:27.511442 2864 tablet_bootstrap.cc:492] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: No bootstrap required, opened a new log
I20260620 22:03:27.511468 2863 tablet_bootstrap.cc:492] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: No bootstrap required, opened a new log
I20260620 22:03:27.511497 2864 ts_tablet_manager.cc:1397] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:27.511509 2863 ts_tablet_manager.cc:1397] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:27.511638 2864 raft_consensus.cc:348] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.511656 2863 raft_consensus.cc:348] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.511701 2864 raft_consensus.cc:374] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.511715 2864 raft_consensus.cc:729] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d27c7f32677a4fae98a7437a953361f1, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.511713 2863 raft_consensus.cc:374] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:27.511736 2863 raft_consensus.cc:729] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cd42170b6b94e43b3ff8c532050e587, State: Initialized, Role: FOLLOWER
I20260620 22:03:27.511767 2864 consensus_queue.cc:260] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.511773 2863 consensus_queue.cc:260] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.511848 2864 ts_tablet_manager.cc:1428] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.511852 2863 ts_tablet_manager.cc:1428] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:27.511870 2869 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.511929 2869 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:27.512048 2870 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.512136 2870 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:27.532300 2870 raft_consensus.cc:482] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:27.532351 2870 raft_consensus.cc:504] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.532578 2870 leader_election.cc:288] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d27c7f32677a4fae98a7437a953361f1 (127.1.55.193:44059), b4dcdb6b6b844de8bd478c86a876d858 (127.1.55.195:39717)
I20260620 22:03:27.535652 2595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.532704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:44059 (local address 127.1.55.194:48995)
0620 22:03:27.532759 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.532770 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.532813 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.532925 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.532926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.532928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.532980 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.532981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.533844 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.533844 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.535018 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.535021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.535462 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.535462 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.535538 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.535542 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.535586 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.535613 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260620 22:03:27.535688 2857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.532773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:48995 (local address 127.1.55.193:44059)
0620 22:03:27.532821 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.532823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.532832 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:27.532861 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.532862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.532870 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.532915 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.533040 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.533772 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.535094 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.535386 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.535435 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.535439 (+ 4us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.535607 (+ 168us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.535637 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 22:03:27.535975 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e48d95a45c44e21b2e9ceaec629a0dc" candidate_uuid: "1cd42170b6b94e43b3ff8c532050e587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27c7f32677a4fae98a7437a953361f1" is_pre_election: true
I20260620 22:03:27.536087 2516 raft_consensus.cc:2454] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cd42170b6b94e43b3ff8c532050e587 in term 0.
I20260620 22:03:27.536238 2588 leader_election.cc:302] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cd42170b6b94e43b3ff8c532050e587, d27c7f32677a4fae98a7437a953361f1; no voters:
I20260620 22:03:27.536398 2870 raft_consensus.cc:2781] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:27.536406 2904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.532809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:39717 (local address 127.1.55.194:59599)
0620 22:03:27.532905 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.532913 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.532963 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.533110 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.533111 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.533112 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:27.533158 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.533159 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.533980 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.533980 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.535467 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.535468 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.536141 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.536142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.536221 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.536225 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.536280 (+ 55us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.536317 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":43,"threads_started":1}
I20260620 22:03:27.536458 2860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.532853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:59599 (local address 127.1.55.195:39717)
0620 22:03:27.532895 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.532896 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.532952 (+ 56us) server_negotiation.cc:407] Connection header received
0620 22:03:27.533031 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.533031 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.533049 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.533099 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:27.533215 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.533898 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.535536 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.536021 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.536114 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.536120 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.536351 (+ 231us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.536392 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:03:27.536448 2870 raft_consensus.cc:482] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:27.536497 2870 raft_consensus.cc:3037] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.537010 2870 raft_consensus.cc:504] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.537091 2870 leader_election.cc:288] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [CANDIDATE]: Term 1 election: Requested vote from peers d27c7f32677a4fae98a7437a953361f1 (127.1.55.193:44059), b4dcdb6b6b844de8bd478c86a876d858 (127.1.55.195:39717)
I20260620 22:03:27.537312 2516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e48d95a45c44e21b2e9ceaec629a0dc" candidate_uuid: "1cd42170b6b94e43b3ff8c532050e587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d27c7f32677a4fae98a7437a953361f1"
I20260620 22:03:27.537384 2516 raft_consensus.cc:3037] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.537400 2796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e48d95a45c44e21b2e9ceaec629a0dc" candidate_uuid: "1cd42170b6b94e43b3ff8c532050e587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4dcdb6b6b844de8bd478c86a876d858" is_pre_election: true
I20260620 22:03:27.537400 2795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e48d95a45c44e21b2e9ceaec629a0dc" candidate_uuid: "1cd42170b6b94e43b3ff8c532050e587" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4dcdb6b6b844de8bd478c86a876d858"
I20260620 22:03:27.537519 2796 raft_consensus.cc:2454] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cd42170b6b94e43b3ff8c532050e587 in term 0.
I20260620 22:03:27.537982 2516 raft_consensus.cc:2454] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cd42170b6b94e43b3ff8c532050e587 in term 1.
I20260620 22:03:27.538112 2588 leader_election.cc:302] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1cd42170b6b94e43b3ff8c532050e587, d27c7f32677a4fae98a7437a953361f1; no voters: b4dcdb6b6b844de8bd478c86a876d858
I20260620 22:03:27.538208 2870 raft_consensus.cc:2781] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:27.538317 2870 raft_consensus.cc:686] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [term 1 LEADER]: Becoming Leader. State: Replica: 1cd42170b6b94e43b3ff8c532050e587, State: Running, Role: LEADER
I20260620 22:03:27.538362 2870 consensus_queue.cc:237] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } }
I20260620 22:03:27.538671 2905 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: TxnStatusTablet state changed. Reason: New leader 1cd42170b6b94e43b3ff8c532050e587. Latest consensus state: current_term: 1 leader_uuid: "1cd42170b6b94e43b3ff8c532050e587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.538785 2905 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:03:27.538944 2907 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 22:03:27.538897 2359 catalog_manager.cc:5495] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cd42170b6b94e43b3ff8c532050e587 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "1cd42170b6b94e43b3ff8c532050e587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } health_report { overall_health: UNKNOWN } } }
I20260620 22:03:27.539027 2907 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260620 22:03:27.548871 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.546373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44606 (local address 127.1.55.194:38803)
0620 22:03:27.546403 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.546404 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.546485 (+ 81us) server_negotiation.cc:407] Connection header received
0620 22:03:27.546571 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.546571 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.546582 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.546632 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:27.546756 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.547155 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.548232 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.548391 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.548433 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.548647 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:27.548717 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:27.548761 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.548825 (+ 64us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.548836 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:03:27.548923 2900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.546340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:38803 (local address 127.0.0.1:44606)
0620 22:03:27.546430 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.546440 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.546496 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.546636 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.546637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.546638 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:03:27.546676 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.546678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.547225 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.547226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.548149 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.548151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.548462 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.548463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.548537 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.548559 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:03:27.548770 (+ 211us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:03:27.548776 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.548824 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.548860 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260620 22:03:27.549712 2795 raft_consensus.cc:3037] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:27.549744 2516 raft_consensus.cc:1261] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Refusing update from remote peer 1cd42170b6b94e43b3ff8c532050e587: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:27.550429 2795 raft_consensus.cc:1261] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858 [term 1 FOLLOWER]: Refusing update from remote peer 1cd42170b6b94e43b3ff8c532050e587: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:27.550607 2905 consensus_queue.cc:1035] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 22:03:27.550714 2703 tablet.cc:2369] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:03:27.550722 2870 consensus_queue.cc:1035] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:27.551349 2869 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: TxnStatusTablet state changed. Reason: New leader 1cd42170b6b94e43b3ff8c532050e587. Latest consensus state: current_term: 1 leader_uuid: "1cd42170b6b94e43b3ff8c532050e587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.551414 2869 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:27.551393 2882 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: TxnStatusTablet state changed. Reason: New leader 1cd42170b6b94e43b3ff8c532050e587. Latest consensus state: current_term: 1 leader_uuid: "1cd42170b6b94e43b3ff8c532050e587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.551456 2882 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:27.552000 2905 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1cd42170b6b94e43b3ff8c532050e587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.552069 2905 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:03:27.552412 2869 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1cd42170b6b94e43b3ff8c532050e587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.552547 2869 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P d27c7f32677a4fae98a7437a953361f1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:27.556052 2857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.553285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57108 (local address 127.1.55.193:44059)
0620 22:03:27.553316 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.553317 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.553343 (+ 26us) server_negotiation.cc:407] Connection header received
0620 22:03:27.553406 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.553406 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.553417 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.553460 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:27.553583 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.554159 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.555159 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.555307 (+ 148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.555351 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.555523 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:27.555650 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:27.555736 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.555961 (+ 225us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.555976 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:03:27.561972 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.559609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:38803 (local address 127.1.55.193:38393)
0620 22:03:27.559722 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.559730 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.559781 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.559879 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.559880 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.559880 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:03:27.559915 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.559915 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.560674 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.560674 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.561206 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.561207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.561664 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.561665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.561705 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.561715 (+ 10us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:03:27.561862 (+ 147us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:03:27.561863 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.561893 (+ 30us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.561922 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":63,"threads_started":1}
I20260620 22:03:27.561968 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.559666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:38393 (local address 127.1.55.194:38803)
0620 22:03:27.559700 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.559701 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.559772 (+ 71us) server_negotiation.cc:407] Connection header received
0620 22:03:27.559814 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.559815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.559821 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.559878 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:27.559945 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.560605 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.561280 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.561588 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.561650 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.561784 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:27.561810 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:27.561857 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.561897 (+ 40us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.561912 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:03:27.563616 2796 raft_consensus.cc:1261] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 1 FOLLOWER]: Refusing update from remote peer d27c7f32677a4fae98a7437a953361f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:27.563673 2656 raft_consensus.cc:1261] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Refusing update from remote peer d27c7f32677a4fae98a7437a953361f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:27.563895 2869 consensus_queue.cc:1035] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:27.564029 2869 consensus_queue.cc:1035] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:27.566852 2870 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1cd42170b6b94e43b3ff8c532050e587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.566919 2870 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P 1cd42170b6b94e43b3ff8c532050e587: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:03:27.567267 2882 tablet_replica.cc:439] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1cd42170b6b94e43b3ff8c532050e587" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d27c7f32677a4fae98a7437a953361f1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44059 } } peers { permanent_uuid: "1cd42170b6b94e43b3ff8c532050e587" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 38803 } } peers { permanent_uuid: "b4dcdb6b6b844de8bd478c86a876d858" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 39717 } } }
I20260620 22:03:27.567345 2882 tablet_replica.cc:442] T 1e48d95a45c44e21b2e9ceaec629a0dc P b4dcdb6b6b844de8bd478c86a876d858: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:27.572465 2857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.568997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:50291 (local address 127.1.55.193:44059)
0620 22:03:27.569025 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.569027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.569651 (+ 624us) server_negotiation.cc:407] Connection header received
0620 22:03:27.569746 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.569747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.569754 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.569777 (+ 23us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:27.569954 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.570727 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.571695 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.572015 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.572094 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.572252 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:27.572277 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:27.572334 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.572381 (+ 47us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.572393 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260620 22:03:27.572896 2922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.569012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:44059 (local address 127.1.55.194:50291)
0620 22:03:27.569139 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:27.569149 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:27.569677 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:27.569822 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:27.569823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:27.569824 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:03:27.569886 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.569887 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.570838 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.570839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.571632 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:27.571634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.572098 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.572099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:27.572160 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.572171 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:03:27.572340 (+ 169us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:03:27.572341 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:03:27.572379 (+ 38us) client_negotiation.cc:240] Negotiation successful
0620 22:03:27.572413 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260620 22:03:27.589804 2359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37546:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:27.589882 2359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37546:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:27.590451 2359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d177d3a3fc3e4271a701b30adc271e1a: Sending DeleteTablet for 3 replicas of tablet bdcfa1203cb245e0b1c6936338cc415a
I20260620 22:03:27.590634 2496 tablet_service.cc:1514] Processing DeleteTablet for tablet bdcfa1203cb245e0b1c6936338cc415a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:27 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:57096
I20260620 22:03:27.590719 2886 tablet_replica.cc:330] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: stopping tablet replica
I20260620 22:03:27.590782 2886 raft_consensus.cc:2229] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:03:27.590850 2886 raft_consensus.cc:2258] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:27.590919 2763 tablet_service.cc:1514] Processing DeleteTablet for tablet bdcfa1203cb245e0b1c6936338cc415a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:27 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:55292
I20260620 22:03:27.590988 2885 tablet_replica.cc:330] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: stopping tablet replica
I20260620 22:03:27.591034 2885 raft_consensus.cc:2229] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:27.591059 2885 raft_consensus.cc:2258] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:27.591065 2886 ts_tablet_manager.cc:1905] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:27.591151 2636 tablet_service.cc:1514] Processing DeleteTablet for tablet bdcfa1203cb245e0b1c6936338cc415a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:27 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:44600
I20260620 22:03:27.591209 2887 tablet_replica.cc:330] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: stopping tablet replica
I20260620 22:03:27.591241 2887 raft_consensus.cc:2229] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:27.591264 2887 raft_consensus.cc:2258] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:27.591491 2887 ts_tablet_manager.cc:1905] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:27.592589 2886 ts_tablet_manager.cc:1918] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:27.592638 2886 log.cc:1196] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/bdcfa1203cb245e0b1c6936338cc415a
I20260620 22:03:27.592788 2887 ts_tablet_manager.cc:1918] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:27.592833 2887 log.cc:1196] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/bdcfa1203cb245e0b1c6936338cc415a
I20260620 22:03:27.592845 2886 ts_tablet_manager.cc:1939] T bdcfa1203cb245e0b1c6936338cc415a P d27c7f32677a4fae98a7437a953361f1: Deleting consensus metadata
I20260620 22:03:27.593034 2887 ts_tablet_manager.cc:1939] T bdcfa1203cb245e0b1c6936338cc415a P 1cd42170b6b94e43b3ff8c532050e587: Deleting consensus metadata
I20260620 22:03:27.593102 2344 catalog_manager.cc:4841] TS d27c7f32677a4fae98a7437a953361f1 (127.1.55.193:44059): tablet bdcfa1203cb245e0b1c6936338cc415a (table test-table [id=bc02921def54428aba8c3ec92d3eb0fd]) successfully deleted
I20260620 22:03:27.593453 2885 ts_tablet_manager.cc:1905] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:27.594936 2885 ts_tablet_manager.cc:1918] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:27.595000 2885 log.cc:1196] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/bdcfa1203cb245e0b1c6936338cc415a
I20260620 22:03:27.595189 2885 ts_tablet_manager.cc:1939] T bdcfa1203cb245e0b1c6936338cc415a P b4dcdb6b6b844de8bd478c86a876d858: Deleting consensus metadata
I20260620 22:03:27.595326 2344 catalog_manager.cc:4841] TS 1cd42170b6b94e43b3ff8c532050e587 (127.1.55.194:38803): tablet bdcfa1203cb245e0b1c6936338cc415a (table test-table [id=bc02921def54428aba8c3ec92d3eb0fd]) successfully deleted
I20260620 22:03:27.595522 2344 catalog_manager.cc:4841] TS b4dcdb6b6b844de8bd478c86a876d858 (127.1.55.195:39717): tablet bdcfa1203cb245e0b1c6936338cc415a (table test-table [id=bc02921def54428aba8c3ec92d3eb0fd]) successfully deleted
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993007, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:27.605062 2857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.596108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57114 (local address 127.1.55.193:44059)
0620 22:03:27.596143 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.596144 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.596297 (+ 153us) server_negotiation.cc:407] Connection header received
0620 22:03:27.596337 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.596337 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.596345 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.596396 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:27.596968 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.597580 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.598578 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.598838 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.598906 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.601972 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:27.601979 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:27.601979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:27.601985 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:27.603828 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.604220 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.604223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.604223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.604283 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.604485 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.604486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.604486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.604647 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:27.604779 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.604876 (+ 97us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.604954 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260620 22:03:27.605355 2556 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57114
I20260620 22:03:27.616050 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:27.606105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37560 (local address 127.1.55.254:45753)
0620 22:03:27.606142 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:27.606143 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:27.609664 (+ 3521us) server_negotiation.cc:407] Connection header received
0620 22:03:27.609706 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:27.609707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:27.609738 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:27.609798 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:27.610355 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.611027 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.611929 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:27.612195 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:27.612259 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:27.613396 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:27.613398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:27.613398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:27.613404 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:27.615044 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.615371 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.615372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.615372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.615425 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:27.615614 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:27.615615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:27.615615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:27.615722 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:27.615810 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:27.615912 (+ 102us) server_negotiation.cc:299] Negotiation successful
0620 22:03:27.615978 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260620 22:03:27.616297 2359 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37560
I20260620 22:03:27.616855 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 2431
I20260620 22:03:27.624219 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 2571
I20260620 22:03:27.629431 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 2711
I20260620 22:03:27.634727 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 2327
2026-06-20T22:03:27Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2090 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2932](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2932](info): set up 2 sockets
Jun 20 22:03:27 dist-test-slave-xw35 krb5kdc[2932](info): commencing operation
krb5kdc: starting...
W20260620 22:03:28.612859 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.958s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:28 dist-test-slave-xw35 krb5kdc[2932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:28.711918 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:33237
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:33237
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:28.783398 2945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:28.783569 2945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:28.783591 2945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:28.784729 2945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:28.784768 2945 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260620 22:03:28.784781 2945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:28.784794 2945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:28.784852 2945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:28.784869 2945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:28.786202 2945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:33237
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:33237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:28.786441 2945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:28.786684 2945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:28.791076 2950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:28.791105 2945 server_base.cc:1034] running on GCE node
W20260620 22:03:28.791054 2953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:28.791070 2951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:28.791416 2945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:28.791700 2945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:28.792832 2945 hybrid_clock.cc:648] HybridClock initialized: now 1781993008792814 us; error 34 us; skew 500 ppm
Jun 20 22:03:28 dist-test-slave-xw35 krb5kdc[2932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993008, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:28.795233 2945 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:28.795617 2945 webserver.cc:460] Webserver started at http://127.1.55.254:42249/ using document root <none> and password file <none>
I20260620 22:03:28.795778 2945 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:28.795814 2945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:28.795887 2945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:28.796710 2945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "e694459d727e4c5a9aa14eaf6cf3b422"
format_stamp: "Formatted at 2026-06-20 22:03:28 on dist-test-slave-xw35"
server_key: "0a951ca439c168705fd9fa00d955d338"
server_key_iv: "c816e81eafc32a94e4f3d4780c96d993"
server_key_version: "encryptionkey@0"
I20260620 22:03:28.796960 2945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "e694459d727e4c5a9aa14eaf6cf3b422"
format_stamp: "Formatted at 2026-06-20 22:03:28 on dist-test-slave-xw35"
server_key: "0a951ca439c168705fd9fa00d955d338"
server_key_iv: "c816e81eafc32a94e4f3d4780c96d993"
server_key_version: "encryptionkey@0"
I20260620 22:03:28.798159 2945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:03:28.798738 2960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:28.798897 2945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:28.798966 2945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "e694459d727e4c5a9aa14eaf6cf3b422"
format_stamp: "Formatted at 2026-06-20 22:03:28 on dist-test-slave-xw35"
server_key: "0a951ca439c168705fd9fa00d955d338"
server_key_iv: "c816e81eafc32a94e4f3d4780c96d993"
server_key_version: "encryptionkey@0"
I20260620 22:03:28.799012 2945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:28.825049 2945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:28.826745 2945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:28.826833 2945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:28.830899 2945 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:33237
I20260620 22:03:28.831012 3022 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:33237 every 8 connection(s)
I20260620 22:03:28.831228 2945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:28.831775 3023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:28.833782 3023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: Bootstrap starting.
I20260620 22:03:28.834339 3023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:28.834626 3023 log.cc:824] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:28.835273 3023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: No bootstrap required, opened a new log
I20260620 22:03:28.835645 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 2945
I20260620 22:03:28.835716 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:28.835884 1247 external_mini_cluster.cc:1428] Setting key 20bf368e13eb425a75f3d02af37ff912
I20260620 22:03:28.837670 3023 raft_consensus.cc:348] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e694459d727e4c5a9aa14eaf6cf3b422" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33237 } }
I20260620 22:03:28.837829 3023 raft_consensus.cc:374] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:28.837862 3023 raft_consensus.cc:729] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e694459d727e4c5a9aa14eaf6cf3b422, State: Initialized, Role: FOLLOWER
I20260620 22:03:28.837981 3023 consensus_queue.cc:260] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e694459d727e4c5a9aa14eaf6cf3b422" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33237 } }
I20260620 22:03:28.838065 3023 raft_consensus.cc:388] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:28.838128 3023 raft_consensus.cc:482] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:28.838172 3023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:28.838631 3023 raft_consensus.cc:504] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e694459d727e4c5a9aa14eaf6cf3b422" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33237 } }
I20260620 22:03:28.838706 3023 leader_election.cc:302] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e694459d727e4c5a9aa14eaf6cf3b422; no voters:
I20260620 22:03:28.838889 3023 leader_election.cc:288] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:28.838909 3028 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:28.839007 3028 raft_consensus.cc:686] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [term 1 LEADER]: Becoming Leader. State: Replica: e694459d727e4c5a9aa14eaf6cf3b422, State: Running, Role: LEADER
I20260620 22:03:28.839084 3028 consensus_queue.cc:237] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e694459d727e4c5a9aa14eaf6cf3b422" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33237 } }
I20260620 22:03:28.839107 3023 sys_catalog.cc:564] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:28.839357 3029 sys_catalog.cc:455] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e694459d727e4c5a9aa14eaf6cf3b422" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e694459d727e4c5a9aa14eaf6cf3b422" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33237 } } }
I20260620 22:03:28.839423 3029 sys_catalog.cc:458] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:28.839579 3030 sys_catalog.cc:455] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e694459d727e4c5a9aa14eaf6cf3b422. Latest consensus state: current_term: 1 leader_uuid: "e694459d727e4c5a9aa14eaf6cf3b422" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e694459d727e4c5a9aa14eaf6cf3b422" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33237 } } }
I20260620 22:03:28.839629 3030 sys_catalog.cc:458] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:28.839720 3033 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:28.840111 3033 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:28.841303 3045 mvcc.cc:205] Tried to move back new op lower bound from 7299043364212260864 to 7299043364205215744. Current Snapshot: MvccSnapshot[applied={T|T < 7299043364212260864}]
I20260620 22:03:28.841696 3033 catalog_manager.cc:1347] Generated new cluster ID: 9845c60c9b56483cad124da620708b4a
I20260620 22:03:28.841735 3033 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:03:28 dist-test-slave-xw35 krb5kdc[2932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:28.846840 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:28.836304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39814 (local address 127.1.55.254:33237)
0620 22:03:28.836451 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:28.836458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:28.836478 (+ 20us) server_negotiation.cc:407] Connection header received
0620 22:03:28.837234 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:28.837240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:28.837280 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:28.837375 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:28.838076 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:28.839025 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:28.840215 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:28.840741 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:28.841089 (+ 348us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:28.843259 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:28.843263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:28.843263 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:28.843273 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:28.845261 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:28.845733 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:28.845736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:28.845736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:28.845835 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:28.846051 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:28.846052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:28.846052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:28.846259 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:28.846425 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:28.846551 (+ 126us) server_negotiation.cc:299] Negotiation successful
0620 22:03:28.846676 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":73,"threads_started":1}
I20260620 22:03:28.871068 3033 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:28.871527 3033 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:28.877180 3033 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: Generated new TSK 0
I20260620 22:03:28.877349 3033 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:28.906415 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33237
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:28.983587 3049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:28.983743 3049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:28.983765 3049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:28.984937 3049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:28.984977 3049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:28.984997 3049 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260620 22:03:28.985047 3049 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:03:28.985080 3049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:28.986346 3049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:33237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:28.986506 3049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:28.986714 3049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:28.991202 3055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:28.991206 3057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:28.991207 3054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:28.991396 3049 server_base.cc:1034] running on GCE node
I20260620 22:03:28.991573 3049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:28.991798 3049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:28.992942 3049 hybrid_clock.cc:648] HybridClock initialized: now 1781993008992910 us; error 42 us; skew 500 ppm
Jun 20 22:03:28 dist-test-slave-xw35 krb5kdc[2932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993008, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:28.995235 3049 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:28.995615 3049 webserver.cc:460] Webserver started at http://127.1.55.193:44951/ using document root <none> and password file <none>
I20260620 22:03:28.995805 3049 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:28.995859 3049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:28.995966 3049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:28.996794 3049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "0fb5701d780746ebb6fd94c91f56b8d1"
format_stamp: "Formatted at 2026-06-20 22:03:28 on dist-test-slave-xw35"
server_key: "51436984235aab747746270362e33a62"
server_key_iv: "247debc0e06c7b9357d5dac0038dbdde"
server_key_version: "encryptionkey@0"
I20260620 22:03:28.997110 3049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "0fb5701d780746ebb6fd94c91f56b8d1"
format_stamp: "Formatted at 2026-06-20 22:03:28 on dist-test-slave-xw35"
server_key: "51436984235aab747746270362e33a62"
server_key_iv: "247debc0e06c7b9357d5dac0038dbdde"
server_key_version: "encryptionkey@0"
I20260620 22:03:28.998378 3049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:28.998991 3064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:28.999150 3049 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:28.999235 3049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "0fb5701d780746ebb6fd94c91f56b8d1"
format_stamp: "Formatted at 2026-06-20 22:03:28 on dist-test-slave-xw35"
server_key: "51436984235aab747746270362e33a62"
server_key_iv: "247debc0e06c7b9357d5dac0038dbdde"
server_key_version: "encryptionkey@0"
I20260620 22:03:28.999302 3049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:29.008826 3049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:29.010370 3049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:29.010502 3049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:29.010986 3049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:29.011034 3049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.011062 3049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:29.011083 3049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 22:03:29 dist-test-slave-xw35 krb5kdc[2932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993008, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:29.018014 3049 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:41381
I20260620 22:03:29.018124 3179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:41381 every 8 connection(s)
I20260620 22:03:29.018373 3049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:29.020152 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.011329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:41209 (local address 127.1.55.254:33237)
0620 22:03:29.011389 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.011391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.011579 (+ 188us) server_negotiation.cc:407] Connection header received
0620 22:03:29.012006 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.012008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.012021 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.012103 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:29.012635 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.013436 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.014431 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.014657 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.014743 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.017614 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:29.017615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:29.017615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:29.017631 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:29.019151 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.019504 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.019505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.019506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.019565 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.019738 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.019738 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.019738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.019820 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:29.019859 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.020031 (+ 172us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.020094 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 22:03:29.020278 3073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.011322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33237 (local address 127.1.55.193:41209)
0620 22:03:29.011466 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.011499 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.011928 (+ 429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.012144 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.012147 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.012333 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:29.012540 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.012544 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.013562 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.013563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.014323 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.014325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.014754 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.014755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.014871 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.015388 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:29.015400 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:29.017454 (+ 2054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:29.019216 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.019220 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.019221 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.019454 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.019620 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.019620 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.019620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.019701 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.019864 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:29.019868 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:29.019955 (+ 87us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.020023 (+ 68us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.020120 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":74,"threads_started":1}
I20260620 22:03:29.020794 3180 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33237
I20260620 22:03:29.020792 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 3049
I20260620 22:03:29.020869 3180 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:29.020901 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:29.021034 3180 heartbeater.cc:511] Master 127.1.55.254:33237 requested a full tablet report, sending...
I20260620 22:03:29.021060 1247 external_mini_cluster.cc:1428] Setting key 7b6943ae0970815e5d6c0d2948c91048
I20260620 22:03:29.021550 2976 ts_manager.cc:194] Registered new tserver with Master: 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381)
I20260620 22:03:29.022365 2976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:41209
I20260620 22:03:29.027441 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.021941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:48861 (local address 127.1.55.254:33237)
0620 22:03:29.021976 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.021978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.022158 (+ 180us) server_negotiation.cc:407] Connection header received
0620 22:03:29.022177 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.022178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.022186 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.022223 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:29.022602 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.023299 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.023937 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.024141 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.024223 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.025138 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:29.025139 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:29.025139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:29.025144 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:29.026430 (+ 1286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.026815 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.026815 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.026816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.026857 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.027048 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.027048 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.027048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.027121 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:29.027161 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.027315 (+ 154us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.027362 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:03:29.027606 3186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.021924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33237 (local address 127.1.55.193:48861)
0620 22:03:29.022063 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.022072 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.022125 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.022244 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.022244 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.022456 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:29.022520 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.022522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.023382 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.023382 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.023853 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.023855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.024226 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.024227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.024311 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.024649 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:29.024654 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:29.025049 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:29.026510 (+ 1461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.026512 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.026512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.026740 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.026915 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.026916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.026916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.026978 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.027179 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:29.027180 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:29.027227 (+ 47us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.027304 (+ 77us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.027436 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:29.043807 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33237
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:29.117188 3189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:29.117345 3189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:29.117367 3189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:29.118372 3189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:29.118405 3189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:29.118424 3189 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260620 22:03:29.118436 3189 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:03:29.118453 3189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:29.119678 3189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:33237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:29.119848 3189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:29.119997 3189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:29.124607 3194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:29.124593 3197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:29.124578 3195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:29.124619 3189 server_base.cc:1034] running on GCE node
I20260620 22:03:29.124946 3189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:29.125183 3189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:29.126331 3189 hybrid_clock.cc:648] HybridClock initialized: now 1781993009126334 us; error 43 us; skew 500 ppm
Jun 20 22:03:29 dist-test-slave-xw35 krb5kdc[2932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993009, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:29.128624 3189 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:29.128973 3189 webserver.cc:460] Webserver started at http://127.1.55.194:46815/ using document root <none> and password file <none>
I20260620 22:03:29.129160 3189 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:29.129197 3189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:29.129272 3189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:29.130129 3189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "14fd45997fde49fdbd9ee9b961128e03"
format_stamp: "Formatted at 2026-06-20 22:03:29 on dist-test-slave-xw35"
server_key: "d24d893de435e0044093afb27210b0be"
server_key_iv: "47e0c1093f6913d4d2cb8b953e19ad96"
server_key_version: "encryptionkey@0"
I20260620 22:03:29.130388 3189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "14fd45997fde49fdbd9ee9b961128e03"
format_stamp: "Formatted at 2026-06-20 22:03:29 on dist-test-slave-xw35"
server_key: "d24d893de435e0044093afb27210b0be"
server_key_iv: "47e0c1093f6913d4d2cb8b953e19ad96"
server_key_version: "encryptionkey@0"
I20260620 22:03:29.131522 3189 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:03:29.132124 3204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.132273 3189 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:29.132349 3189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "14fd45997fde49fdbd9ee9b961128e03"
format_stamp: "Formatted at 2026-06-20 22:03:29 on dist-test-slave-xw35"
server_key: "d24d893de435e0044093afb27210b0be"
server_key_iv: "47e0c1093f6913d4d2cb8b953e19ad96"
server_key_version: "encryptionkey@0"
I20260620 22:03:29.132414 3189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:29.141144 3189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:29.143142 3189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:29.143285 3189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:29.143704 3189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:29.143754 3189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.143772 3189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:29.143784 3189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.150230 3189 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:34433
I20260620 22:03:29.150256 3319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:34433 every 8 connection(s)
Jun 20 22:03:29 dist-test-slave-xw35 krb5kdc[2932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993009, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:29.150561 3189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:03:29.152969 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.144233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:51957 (local address 127.1.55.254:33237)
0620 22:03:29.144275 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.144277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.144476 (+ 199us) server_negotiation.cc:407] Connection header received
0620 22:03:29.144903 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.144905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.144918 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.144978 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:29.145839 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.146620 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.148133 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.148483 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.148570 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.150888 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:29.150889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:29.150890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:29.150898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:29.151988 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.152312 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.152313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.152313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.152358 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.152512 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.152512 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.152512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.152606 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:29.152651 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.152863 (+ 212us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.152914 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:03:29.153108 3213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.144232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33237 (local address 127.1.55.194:51957)
0620 22:03:29.144374 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.144403 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.144807 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.145090 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.145094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.145447 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:29.145748 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.145755 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.146723 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.146724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.148029 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.148031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.148610 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.148611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.148705 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.149140 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:29.149149 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:29.150806 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:29.152056 (+ 1250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.152061 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.152063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.152251 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.152395 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.152395 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.152396 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.152467 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.152660 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:29.152664 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:29.152765 (+ 101us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.152835 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.152929 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":89,"threads_started":1}
I20260620 22:03:29.153508 3320 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33237
I20260620 22:03:29.153591 3320 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:29.153736 3320 heartbeater.cc:511] Master 127.1.55.254:33237 requested a full tablet report, sending...
I20260620 22:03:29.154111 2976 ts_manager.cc:194] Registered new tserver with Master: 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433)
I20260620 22:03:29.154506 2976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:51957
I20260620 22:03:29.157740 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 3189
I20260620 22:03:29.157829 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:29.157979 1247 external_mini_cluster.cc:1428] Setting key f867a317ce1fca2e6ab98598583a9a94
I20260620 22:03:29.159389 3326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.154422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33237 (local address 127.1.55.194:35677)
0620 22:03:29.154559 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.154605 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.154677 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.154823 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.154824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.155005 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:29.155078 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.155080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.155688 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.155689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.156107 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.156108 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.156376 (+ 268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.156377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.156438 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.156835 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:29.156839 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:29.157077 (+ 238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:29.158537 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.158538 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.158539 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.158712 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.158884 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.158884 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.158884 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.158923 (+ 39us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.159203 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:29.159203 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:29.159233 (+ 30us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.159280 (+ 47us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.159338 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
I20260620 22:03:29.159489 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.154510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:35677 (local address 127.1.55.254:33237)
0620 22:03:29.154554 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.154556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.154652 (+ 96us) server_negotiation.cc:407] Connection header received
0620 22:03:29.154725 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.154725 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.154734 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.154793 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:29.155147 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.155611 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.156167 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.156324 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.156363 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.157138 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:29.157138 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:29.157139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:29.157143 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:29.158473 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.158777 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.158778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.158778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.158828 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.158972 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.158973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.158974 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.159141 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:29.159205 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.159301 (+ 96us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.159372 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:29.179904 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33237
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:29.253623 3329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:29.253786 3329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:29.253810 3329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:29.254856 3329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:29.254889 3329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:29.254909 3329 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260620 22:03:29.254921 3329 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:03:29.254937 3329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:29.256247 3329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:33237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:29.256402 3329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:29.256546 3329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:29.260679 3334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:29.260725 3337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:29.260691 3335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:29.260890 3329 server_base.cc:1034] running on GCE node
I20260620 22:03:29.261052 3329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:29.261202 3329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:29.262344 3329 hybrid_clock.cc:648] HybridClock initialized: now 1781993009262332 us; error 26 us; skew 500 ppm
Jun 20 22:03:29 dist-test-slave-xw35 krb5kdc[2932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993009, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:29.264500 3329 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:29.264921 3329 webserver.cc:460] Webserver started at http://127.1.55.195:33181/ using document root <none> and password file <none>
I20260620 22:03:29.265142 3329 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:29.265180 3329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:29.265334 3329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:29.266220 3329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "d347c661115549659767f5301d523d0c"
format_stamp: "Formatted at 2026-06-20 22:03:29 on dist-test-slave-xw35"
server_key: "21d6861636ce78b921ce30025aa60b6a"
server_key_iv: "2976dc6845fb122e40668372469ce311"
server_key_version: "encryptionkey@0"
I20260620 22:03:29.266510 3329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "d347c661115549659767f5301d523d0c"
format_stamp: "Formatted at 2026-06-20 22:03:29 on dist-test-slave-xw35"
server_key: "21d6861636ce78b921ce30025aa60b6a"
server_key_iv: "2976dc6845fb122e40668372469ce311"
server_key_version: "encryptionkey@0"
I20260620 22:03:29.267670 3329 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:29.268334 3344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.268517 3329 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:29.268618 3329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "d347c661115549659767f5301d523d0c"
format_stamp: "Formatted at 2026-06-20 22:03:29 on dist-test-slave-xw35"
server_key: "21d6861636ce78b921ce30025aa60b6a"
server_key_iv: "2976dc6845fb122e40668372469ce311"
server_key_version: "encryptionkey@0"
I20260620 22:03:29.268710 3329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:29.280584 3329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:29.282120 3329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:29.282250 3329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:29.282702 3329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:29.282737 3329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.282756 3329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:29.282768 3329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 22:03:29 dist-test-slave-xw35 krb5kdc[2932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993009, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:29.289418 3329 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:41417
I20260620 22:03:29.289803 3329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:03:29.290203 3459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:41417 every 8 connection(s)
I20260620 22:03:29.291510 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.283086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:52461 (local address 127.1.55.254:33237)
0620 22:03:29.283155 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.283158 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.283372 (+ 214us) server_negotiation.cc:407] Connection header received
0620 22:03:29.284005 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.284006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.284018 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.284078 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:29.284889 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.285455 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.286425 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.286614 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.286686 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.289014 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:29.289015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:29.289016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:29.289028 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:29.290532 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.290836 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.290836 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.290837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.290879 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.291058 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.291058 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.291058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.291142 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:29.291185 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.291405 (+ 220us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.291455 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260620 22:03:29.291683 3353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.283043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33237 (local address 127.1.55.195:52461)
0620 22:03:29.283242 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.283283 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.283899 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.284153 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.284157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.284520 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:29.284793 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.284799 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.285612 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.285613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.286325 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.286327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.286694 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.286694 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.286805 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.287239 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:29.287246 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:29.288919 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:29.290592 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.290596 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.290597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.290775 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.290929 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.290929 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.290930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.291009 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.291189 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:29.291193 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:29.291299 (+ 106us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.291381 (+ 82us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.291474 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260620 22:03:29.292141 3460 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33237
I20260620 22:03:29.292215 3460 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:29.292371 3460 heartbeater.cc:511] Master 127.1.55.254:33237 requested a full tablet report, sending...
I20260620 22:03:29.292698 2976 ts_manager.cc:194] Registered new tserver with Master: d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:29.293144 2976 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:52461
I20260620 22:03:29.293754 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 3329
I20260620 22:03:29.293874 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:29.294050 1247 external_mini_cluster.cc:1428] Setting key 0bfcac3c1ce452930be41a28708c2140
I20260620 22:03:29.294764 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:03:29.298635 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.292995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:33101 (local address 127.1.55.254:33237)
0620 22:03:29.293023 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.293025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.293126 (+ 101us) server_negotiation.cc:407] Connection header received
0620 22:03:29.293165 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.293166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.293174 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.293230 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:29.293574 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.294208 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.295161 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.295321 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.295371 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.296247 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:29.296248 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:29.296248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:29.296253 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:29.297701 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.298056 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.298056 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.298056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.298099 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.298274 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.298274 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.298274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.298351 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:29.298393 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.298537 (+ 144us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.298586 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:03:29.298818 3466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.292952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33237 (local address 127.1.55.195:33101)
0620 22:03:29.293061 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.293069 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.293129 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.293259 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.293261 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.293424 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:29.293517 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.293518 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.294303 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.294304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.295090 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.295092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.295392 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.295393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.295473 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.295800 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:29.295805 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:29.296174 (+ 369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:29.297778 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.297779 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.297779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.297981 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.298157 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.298157 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.298158 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.298221 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.298407 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:29.298407 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:29.298449 (+ 42us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.298515 (+ 66us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.298611 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":76,"threads_started":1}
Jun 20 22:03:29 dist-test-slave-xw35 krb5kdc[2932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 22:03:29 dist-test-slave-xw35 krb5kdc[2932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:29.316073 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.310002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39822 (local address 127.1.55.254:33237)
0620 22:03:29.310044 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.310046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.310076 (+ 30us) server_negotiation.cc:407] Connection header received
0620 22:03:29.310148 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.310148 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.310156 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.310217 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:29.310737 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.311151 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.311908 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.312097 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.312175 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.314255 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:29.314256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:29.314256 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:29.314262 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:29.315340 (+ 1078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.315613 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.315614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.315614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.315655 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.315784 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.315784 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.315784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.315858 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:29.315916 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.315986 (+ 70us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.316029 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:03:29.317564 2976 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39822:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:29.318934 2976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:29.324481 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.320780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:41417 (local address 127.0.0.1:36688)
0620 22:03:29.321144 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.321153 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.321191 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.321392 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.321393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.321395 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.321432 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.321443 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.322334 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.322335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.323457 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.323460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.324198 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.324199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.324274 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.324287 (+ 13us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.324349 (+ 62us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.324405 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":30,"thread_start_us":43,"threads_started":1}
I20260620 22:03:29.324566 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.320917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44294 (local address 127.1.55.193:41381)
0620 22:03:29.321501 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.321505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.321514 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:29.321555 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.321557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.321571 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.321770 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.321827 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.322661 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.323471 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.324181 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.324288 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.324348 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.324415 (+ 67us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.324452 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":77,"threads_started":1}
I20260620 22:03:29.324797 3477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.320924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36688 (local address 127.1.55.195:41417)
0620 22:03:29.321269 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.321272 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.321280 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:03:29.321306 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.321308 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.321319 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.321383 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.321552 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.322257 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.323557 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.324111 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.324197 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.324247 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.324680 (+ 433us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.324715 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":63,"threads_started":1}
I20260620 22:03:29.324867 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.320985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54510 (local address 127.1.55.194:34433)
0620 22:03:29.321130 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.321134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.321146 (+ 12us) server_negotiation.cc:407] Connection header received
0620 22:03:29.321181 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.321183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.321197 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.321275 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.321410 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.322393 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.323589 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.324297 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.324356 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.324404 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.324744 (+ 340us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.324775 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
I20260620 22:03:29.324491 3474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.320745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41381 (local address 127.0.0.1:44294)
0620 22:03:29.320841 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.320874 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.320963 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.321671 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.321672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.321674 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.321709 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.321710 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.322733 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.322734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.323388 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.323390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.324290 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.324290 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.324351 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.324354 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.324404 (+ 50us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.324432 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"mutex_wait_us":18,"thread_start_us":57,"threads_started":1}
I20260620 22:03:29.324681 3475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.320779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34433 (local address 127.0.0.1:54510)
0620 22:03:29.321042 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.321052 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.321099 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.321293 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.321295 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.321297 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.321334 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.321334 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.322463 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.322463 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.323457 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.323460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.324436 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.324438 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.324498 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.324503 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.324553 (+ 50us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.324600 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":71,"threads_started":1}
I20260620 22:03:29.325477 3394 tablet_service.cc:1467] Processing CreateTablet for tablet b1478bea578c4973b590f461179b9ec3 (DEFAULT_TABLE table=test-table [id=23f1512ed0e8410b81ae80e6fb9010e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:29.325526 3254 tablet_service.cc:1467] Processing CreateTablet for tablet b1478bea578c4973b590f461179b9ec3 (DEFAULT_TABLE table=test-table [id=23f1512ed0e8410b81ae80e6fb9010e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:29.325631 3114 tablet_service.cc:1467] Processing CreateTablet for tablet b1478bea578c4973b590f461179b9ec3 (DEFAULT_TABLE table=test-table [id=23f1512ed0e8410b81ae80e6fb9010e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:29.325825 3394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1478bea578c4973b590f461179b9ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.325832 3254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1478bea578c4973b590f461179b9ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.325879 3114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1478bea578c4973b590f461179b9ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.328413 3480 tablet_bootstrap.cc:492] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Bootstrap starting.
I20260620 22:03:29.328737 3481 tablet_bootstrap.cc:492] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: Bootstrap starting.
I20260620 22:03:29.328984 3482 tablet_bootstrap.cc:492] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Bootstrap starting.
I20260620 22:03:29.329421 3480 tablet_bootstrap.cc:654] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.329452 3481 tablet_bootstrap.cc:654] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.329550 3482 tablet_bootstrap.cc:654] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.329757 3481 log.cc:824] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:29.329757 3480 log.cc:824] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:29.329803 3482 log.cc:824] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:29.330467 3481 tablet_bootstrap.cc:492] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: No bootstrap required, opened a new log
I20260620 22:03:29.330531 3481 ts_tablet_manager.cc:1397] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:29.330490 3482 tablet_bootstrap.cc:492] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: No bootstrap required, opened a new log
I20260620 22:03:29.330592 3482 ts_tablet_manager.cc:1397] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 22:03:29.330605 3480 tablet_bootstrap.cc:492] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: No bootstrap required, opened a new log
I20260620 22:03:29.330652 3480 ts_tablet_manager.cc:1397] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:29.331763 3482 raft_consensus.cc:348] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.331894 3482 raft_consensus.cc:374] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.331933 3482 raft_consensus.cc:729] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fb5701d780746ebb6fd94c91f56b8d1, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.332259 3482 consensus_queue.cc:260] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.332267 3481 raft_consensus.cc:348] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.332407 3481 raft_consensus.cc:374] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.332345 3480 raft_consensus.cc:348] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.332437 3481 raft_consensus.cc:729] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d347c661115549659767f5301d523d0c, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.332453 3480 raft_consensus.cc:374] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.332484 3480 raft_consensus.cc:729] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fd45997fde49fdbd9ee9b961128e03, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.332517 3482 ts_tablet_manager.cc:1428] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:03:29.332558 3481 consensus_queue.cc:260] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.332583 3480 consensus_queue.cc:260] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.332630 3180 heartbeater.cc:503] Master 127.1.55.254:33237 was elected leader, sending a full tablet report...
I20260620 22:03:29.332818 3481 ts_tablet_manager.cc:1428] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 22:03:29.332818 3480 ts_tablet_manager.cc:1428] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:03:29.333014 3460 heartbeater.cc:503] Master 127.1.55.254:33237 was elected leader, sending a full tablet report...
I20260620 22:03:29.333267 3320 heartbeater.cc:503] Master 127.1.55.254:33237 was elected leader, sending a full tablet report...
W20260620 22:03:29.401137 3321 tablet.cc:2369] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:03:29.471752 3486 raft_consensus.cc:482] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:29.471874 3486 raft_consensus.cc:504] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.472291 3486 leader_election.cc:288] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d347c661115549659767f5301d523d0c (127.1.55.195:41417), 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433)
I20260620 22:03:29.475258 3488 raft_consensus.cc:482] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:29.475364 3488 raft_consensus.cc:504] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.475669 3488 leader_election.cc:288] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381), 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433)
I20260620 22:03:29.475864 3073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.472431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34433 (local address 127.1.55.193:36737)
0620 22:03:29.472484 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.472496 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.472535 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.472686 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.472687 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.472688 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.472760 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.472778 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.473612 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.473613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.474930 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.474933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.475616 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.475618 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.475690 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.475694 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.475748 (+ 54us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.475793 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":38}
I20260620 22:03:29.475953 3477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.472510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:33123 (local address 127.1.55.195:41417)
0620 22:03:29.472546 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.472547 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.472691 (+ 144us) server_negotiation.cc:407] Connection header received
0620 22:03:29.472719 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.472720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.472730 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.472777 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.472970 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.473590 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.475028 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.475534 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.475604 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.475611 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.475822 (+ 211us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.475862 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:03:29.476167 3489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.472443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:41417 (local address 127.1.55.193:33123)
0620 22:03:29.472609 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.472617 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.472680 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.472800 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.472800 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.472802 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.472887 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.472888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.473650 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.473650 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.474930 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.474933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.475658 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.475661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.475745 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.475750 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.476017 (+ 267us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.476075 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":68,"thread_start_us":93,"threads_started":1}
I20260620 22:03:29.476339 3479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.472481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:36737 (local address 127.1.55.194:34433)
0620 22:03:29.472524 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.472526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.472535 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:29.472609 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.472609 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.472617 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.472680 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.472840 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.473542 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.475028 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.475540 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.475604 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.475611 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.476224 (+ 613us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.476278 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:03:29.476606 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1478bea578c4973b590f461179b9ec3" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fd45997fde49fdbd9ee9b961128e03" is_pre_election: true
I20260620 22:03:29.476743 3274 raft_consensus.cc:2454] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 0.
I20260620 22:03:29.476910 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1478bea578c4973b590f461179b9ec3" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c" is_pre_election: true
I20260620 22:03:29.477003 3414 raft_consensus.cc:2454] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 0.
I20260620 22:03:29.477196 3068 leader_election.cc:302] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, 14fd45997fde49fdbd9ee9b961128e03; no voters:
I20260620 22:03:29.477319 3486 raft_consensus.cc:2781] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:29.477355 3486 raft_consensus.cc:482] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:29.477396 3486 raft_consensus.cc:3037] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.478226 3486 raft_consensus.cc:504] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.478327 3486 leader_election.cc:288] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 election: Requested vote from peers d347c661115549659767f5301d523d0c (127.1.55.195:41417), 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433)
I20260620 22:03:29.478456 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1478bea578c4973b590f461179b9ec3" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fd45997fde49fdbd9ee9b961128e03"
I20260620 22:03:29.478513 3274 raft_consensus.cc:3037] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.478492 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1478bea578c4973b590f461179b9ec3" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c"
I20260620 22:03:29.478572 3414 raft_consensus.cc:3037] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.478595 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.475956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:48523 (local address 127.1.55.193:41381)
0620 22:03:29.475990 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.475991 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.475997 (+ 6us) server_negotiation.cc:407] Connection header received
0620 22:03:29.476014 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.476015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.476024 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.476084 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.476359 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.476965 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.477925 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.478235 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.478310 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.478317 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.478513 (+ 196us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.478544 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:03:29.478754 3353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.475776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41381 (local address 127.1.55.195:48523)
0620 22:03:29.475849 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.475856 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.475883 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.476231 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.476232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.476233 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.476283 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.476285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.477039 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.477040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.477846 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.477849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.478309 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.478310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.478387 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.478391 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.478435 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.478469 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260620 22:03:29.479403 3274 raft_consensus.cc:2454] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 1.
I20260620 22:03:29.479498 3414 raft_consensus.cc:2454] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 1.
I20260620 22:03:29.479581 3490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.475824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34433 (local address 127.1.55.195:38937)
0620 22:03:29.476107 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.476115 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.476152 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.476530 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.476531 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.476533 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.476591 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.476592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.477339 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.477340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.478353 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.478355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.479117 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.479118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.479197 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.479201 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.479262 (+ 61us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.479299 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":105,"threads_started":1}
I20260620 22:03:29.479692 3067 leader_election.cc:302] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, d347c661115549659767f5301d523d0c; no voters:
I20260620 22:03:29.479784 3491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.476128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:38937 (local address 127.1.55.194:34433)
0620 22:03:29.476285 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.476286 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.476293 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:03:29.476311 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.476312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.476321 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.476379 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.476660 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.477279 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.478439 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.479011 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.479090 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.479098 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.479289 (+ 191us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.479335 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":70,"threads_started":1}
I20260620 22:03:29.479790 3486 raft_consensus.cc:2781] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:29.479833 3134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1478bea578c4973b590f461179b9ec3" candidate_uuid: "d347c661115549659767f5301d523d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" is_pre_election: true
I20260620 22:03:29.479929 3486 raft_consensus.cc:686] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 LEADER]: Becoming Leader. State: Replica: 0fb5701d780746ebb6fd94c91f56b8d1, State: Running, Role: LEADER
I20260620 22:03:29.480024 3486 consensus_queue.cc:237] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } }
I20260620 22:03:29.480232 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1478bea578c4973b590f461179b9ec3" candidate_uuid: "d347c661115549659767f5301d523d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fd45997fde49fdbd9ee9b961128e03" is_pre_election: true
I20260620 22:03:29.480312 3274 raft_consensus.cc:2379] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d347c661115549659767f5301d523d0c in current term 1: Already voted for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in this term.
I20260620 22:03:29.480700 3346 leader_election.cc:302] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d347c661115549659767f5301d523d0c; no voters: 0fb5701d780746ebb6fd94c91f56b8d1, 14fd45997fde49fdbd9ee9b961128e03
I20260620 22:03:29.480816 3488 raft_consensus.cc:2726] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 22:03:29.480832 2977 catalog_manager.cc:5495] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } health_report { overall_health: UNKNOWN } } }
W20260620 22:03:29.519059 3181 tablet.cc:2369] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 20 22:03:29 dist-test-slave-xw35 krb5kdc[2932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993008, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:29.528182 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.522002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33237 (local address 127.0.0.1:39824)
0620 22:03:29.522176 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.522186 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.522263 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.522397 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.522398 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.522677 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:29.522716 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.522718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.523314 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.523315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.523774 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.523775 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.524165 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.524166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.524232 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.524661 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:29.524665 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:29.526011 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:29.527198 (+ 1187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.527204 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.527205 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.527391 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.527583 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:29.527584 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:29.527584 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:29.527635 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:29.527902 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:29.527908 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:29.527957 (+ 49us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.528034 (+ 77us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.528117 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260620 22:03:29.528311 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.522074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39824 (local address 127.1.55.254:33237)
0620 22:03:29.522145 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.522148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.522246 (+ 98us) server_negotiation.cc:407] Connection header received
0620 22:03:29.522317 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.522318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.522327 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.522394 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:29.522803 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.523243 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.523864 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.524066 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.524150 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.526090 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:29.526092 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:29.526092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:29.526097 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:29.527137 (+ 1040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.527480 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.527481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.527481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.527527 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:29.527712 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:29.527713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:29.527713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:29.527831 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:29.527895 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.528064 (+ 169us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.528168 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":49}
I20260620 22:03:29.530268 2977 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:39824:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260620 22:03:29.530498 2977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:29.531839 3114 tablet_service.cc:1467] Processing CreateTablet for tablet 46ce4f557bd947e3a7112f8281fdc59b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9f285e13bfc14c84af895fa9d504fe4c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:03:29.531900 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 46ce4f557bd947e3a7112f8281fdc59b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9f285e13bfc14c84af895fa9d504fe4c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:03:29.531955 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 46ce4f557bd947e3a7112f8281fdc59b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9f285e13bfc14c84af895fa9d504fe4c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:03:29.532001 3114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ce4f557bd947e3a7112f8281fdc59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.532068 3394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ce4f557bd947e3a7112f8281fdc59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.532081 3254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ce4f557bd947e3a7112f8281fdc59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.533094 3480 tablet_bootstrap.cc:492] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: Bootstrap starting.
I20260620 22:03:29.533370 3481 tablet_bootstrap.cc:492] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: Bootstrap starting.
I20260620 22:03:29.533560 3480 tablet_bootstrap.cc:654] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.533766 3481 tablet_bootstrap.cc:654] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.534082 3482 tablet_bootstrap.cc:492] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: Bootstrap starting.
I20260620 22:03:29.534499 3481 tablet_bootstrap.cc:492] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: No bootstrap required, opened a new log
I20260620 22:03:29.534525 3482 tablet_bootstrap.cc:654] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.534557 3481 ts_tablet_manager.cc:1397] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:29.534729 3481 raft_consensus.cc:348] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.534807 3481 raft_consensus.cc:374] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.534832 3481 raft_consensus.cc:729] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d347c661115549659767f5301d523d0c, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.534878 3481 consensus_queue.cc:260] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.534981 3481 ts_tablet_manager.cc:1428] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:29.535143 3482 tablet_bootstrap.cc:492] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: No bootstrap required, opened a new log
I20260620 22:03:29.535125 3488 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.535188 3482 ts_tablet_manager.cc:1397] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:29.535188 3488 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:29.535320 3482 raft_consensus.cc:348] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.535394 3482 raft_consensus.cc:374] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.535432 3482 raft_consensus.cc:729] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fb5701d780746ebb6fd94c91f56b8d1, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.535472 3482 consensus_queue.cc:260] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.535559 3482 ts_tablet_manager.cc:1428] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.535622 3492 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.535702 3492 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:29.535888 3480 tablet_bootstrap.cc:492] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: No bootstrap required, opened a new log
I20260620 22:03:29.535938 3480 ts_tablet_manager.cc:1397] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260620 22:03:29.536111 3480 raft_consensus.cc:348] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.536175 3480 raft_consensus.cc:374] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.536199 3480 raft_consensus.cc:729] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fd45997fde49fdbd9ee9b961128e03, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.536252 3480 consensus_queue.cc:260] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.536340 3480 ts_tablet_manager.cc:1428] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.536402 3487 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.536496 3487 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: This TxnStatusTablet replica's current role is: FOLLOWER
W20260620 22:03:29.540400 3461 tablet.cc:2369] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:03:29.573770 3492 raft_consensus.cc:482] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:29.573853 3492 raft_consensus.cc:504] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.574011 3492 leader_election.cc:288] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433), d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:29.574157 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ce4f557bd947e3a7112f8281fdc59b" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c" is_pre_election: true
I20260620 22:03:29.574252 3414 raft_consensus.cc:2454] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 0.
I20260620 22:03:29.574222 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ce4f557bd947e3a7112f8281fdc59b" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fd45997fde49fdbd9ee9b961128e03" is_pre_election: true
I20260620 22:03:29.574286 3274 raft_consensus.cc:2454] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 0.
I20260620 22:03:29.574424 3067 leader_election.cc:302] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, d347c661115549659767f5301d523d0c; no voters:
I20260620 22:03:29.574591 3492 raft_consensus.cc:2781] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:29.574646 3492 raft_consensus.cc:482] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:29.574669 3492 raft_consensus.cc:3037] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.575299 3492 raft_consensus.cc:504] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.575423 3492 leader_election.cc:288] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 election: Requested vote from peers 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433), d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:29.575536 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ce4f557bd947e3a7112f8281fdc59b" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fd45997fde49fdbd9ee9b961128e03"
I20260620 22:03:29.575555 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ce4f557bd947e3a7112f8281fdc59b" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c"
I20260620 22:03:29.575615 3414 raft_consensus.cc:3037] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.575618 3274 raft_consensus.cc:3037] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.576110 3414 raft_consensus.cc:2454] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 1.
I20260620 22:03:29.576196 3274 raft_consensus.cc:2454] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 1.
I20260620 22:03:29.576244 3067 leader_election.cc:302] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, d347c661115549659767f5301d523d0c; no voters:
I20260620 22:03:29.576370 3492 raft_consensus.cc:2781] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:29.576447 3492 raft_consensus.cc:686] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 LEADER]: Becoming Leader. State: Replica: 0fb5701d780746ebb6fd94c91f56b8d1, State: Running, Role: LEADER
I20260620 22:03:29.576498 3492 consensus_queue.cc:237] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.576727 3486 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: TxnStatusTablet state changed. Reason: New leader 0fb5701d780746ebb6fd94c91f56b8d1. Latest consensus state: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.576797 3486 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:03:29.576946 3504 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 22:03:29.576958 2976 catalog_manager.cc:5495] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } health_report { overall_health: UNKNOWN } } }
I20260620 22:03:29.577059 3504 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260620 22:03:29.593833 3499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.591195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41381 (local address 127.0.0.1:44298)
0620 22:03:29.591265 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.591277 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.591327 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.591590 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.591591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.591592 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:03:29.591639 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.591641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.592512 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.592513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.592981 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.592982 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.593383 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.593384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.593423 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.593434 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.593724 (+ 290us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.593729 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.593754 (+ 25us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.593785 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260620 22:03:29.593833 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.591403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44298 (local address 127.1.55.193:41381)
0620 22:03:29.591460 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.591461 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.591470 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:29.591496 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.591497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.591514 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.591581 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:29.591698 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.592446 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.593050 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.593309 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.593372 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.593565 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.593665 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.593736 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.593756 (+ 20us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.593774 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 22:03:29.595335 3414 raft_consensus.cc:1261] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Refusing update from remote peer 0fb5701d780746ebb6fd94c91f56b8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:29.595573 3492 consensus_queue.cc:1035] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:29.595674 3274 raft_consensus.cc:1261] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Refusing update from remote peer 0fb5701d780746ebb6fd94c91f56b8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:29.595861 3492 consensus_queue.cc:1035] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:29.596781 3488 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: TxnStatusTablet state changed. Reason: New leader 0fb5701d780746ebb6fd94c91f56b8d1. Latest consensus state: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.596860 3488 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:29.597770 3487 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: TxnStatusTablet state changed. Reason: New leader 0fb5701d780746ebb6fd94c91f56b8d1. Latest consensus state: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.597846 3487 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:29.598397 3492 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.598461 3492 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:03:29.598817 3488 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.598892 3488 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P d347c661115549659767f5301d523d0c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:29.598996 3508 mvcc.cc:205] Tried to move back new op lower bound from 7299043367300251648 to 7299043367225610240. Current Snapshot: MvccSnapshot[applied={T|T < 7299043367300251648}]
I20260620 22:03:29.599560 3486 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.599630 3486 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P 0fb5701d780746ebb6fd94c91f56b8d1: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:03:29.599975 3487 tablet_replica.cc:439] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } } }
I20260620 22:03:29.600031 3510 mvcc.cc:205] Tried to move back new op lower bound from 7299043367300251648 to 7299043367225610240. Current Snapshot: MvccSnapshot[applied={T|T < 7299043367300251648}]
I20260620 22:03:29.600059 3487 tablet_replica.cc:442] T 46ce4f557bd947e3a7112f8281fdc59b P 14fd45997fde49fdbd9ee9b961128e03: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:03:29.602958 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.600566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44314 (local address 127.1.55.193:41381)
0620 22:03:29.600599 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.600601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.600607 (+ 6us) server_negotiation.cc:407] Connection header received
0620 22:03:29.600623 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.600624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.600630 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.600681 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:29.600772 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.601317 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.602270 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.602553 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.602624 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.602764 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.602791 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.602830 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.602883 (+ 53us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.602897 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:03:29.607231 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.605126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:50909 (local address 127.1.55.193:41381)
0620 22:03:29.605160 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.605162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.605299 (+ 137us) server_negotiation.cc:407] Connection header received
0620 22:03:29.605336 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.605336 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.605344 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.605406 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:29.605545 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.605911 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.606596 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.606752 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.606831 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.606988 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.607014 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.607088 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.607142 (+ 54us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.607172 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":17}
I20260620 22:03:29.607298 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.605086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41381 (local address 127.1.55.193:50909)
0620 22:03:29.605231 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.605239 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.605292 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.605407 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.605408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.605409 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:03:29.605455 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.605457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.605992 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.605992 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.606521 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.606523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.606833 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.606833 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.606892 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.606904 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.607088 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.607090 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.607138 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.607190 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":3,"thread_start_us":93,"threads_started":1}
I20260620 22:03:29.609122 3414 raft_consensus.cc:1261] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Refusing update from remote peer 0fb5701d780746ebb6fd94c91f56b8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:29.609228 3274 raft_consensus.cc:1261] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Refusing update from remote peer 0fb5701d780746ebb6fd94c91f56b8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:29.609310 3492 consensus_queue.cc:1035] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:29.609393 3486 consensus_queue.cc:1035] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:29.622277 2976 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:29.622340 2976 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:29.622893 2976 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: Sending DeleteTablet for 3 replicas of tablet b1478bea578c4973b590f461179b9ec3
I20260620 22:03:29.623149 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet b1478bea578c4973b590f461179b9ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:29 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:54510
I20260620 22:03:29.623162 3114 tablet_service.cc:1514] Processing DeleteTablet for tablet b1478bea578c4973b590f461179b9ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:29 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:44294
I20260620 22:03:29.623162 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet b1478bea578c4973b590f461179b9ec3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:29 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36688
I20260620 22:03:29.623397 3525 tablet_replica.cc:330] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: stopping tablet replica
I20260620 22:03:29.623409 3523 tablet_replica.cc:330] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: stopping tablet replica
I20260620 22:03:29.623550 3523 raft_consensus.cc:2229] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:29.623553 2976 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39822:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:29.623660 2976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:29.623490 3525 raft_consensus.cc:2229] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:03:29.623772 3523 raft_consensus.cc:2258] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:29.623847 3525 raft_consensus.cc:2258] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:29.624338 3523 ts_tablet_manager.cc:1905] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:29.624769 3525 ts_tablet_manager.cc:1905] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:29.624776 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 31d1b06ca8fb4906b09555d8a5bc193a (DEFAULT_TABLE table=test-table [id=b63ee59bfcfa4073b5a5d4d99115f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:29.624873 3254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d1b06ca8fb4906b09555d8a5bc193a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.626106 3523 ts_tablet_manager.cc:1918] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:29.626205 3480 tablet_bootstrap.cc:492] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: Bootstrap starting.
I20260620 22:03:29.626226 3523 log.cc:1196] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/b1478bea578c4973b590f461179b9ec3
I20260620 22:03:29.626573 3480 tablet_bootstrap.cc:654] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.626572 3525 ts_tablet_manager.cc:1918] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:29.626632 3525 log.cc:1196] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/b1478bea578c4973b590f461179b9ec3
I20260620 22:03:29.626591 3523 ts_tablet_manager.cc:1939] T b1478bea578c4973b590f461179b9ec3 P 14fd45997fde49fdbd9ee9b961128e03: Deleting consensus metadata
I20260620 22:03:29.626893 3525 ts_tablet_manager.cc:1939] T b1478bea578c4973b590f461179b9ec3 P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting consensus metadata
I20260620 22:03:29.627233 3524 tablet_replica.cc:330] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: stopping tablet replica
I20260620 22:03:29.627254 2964 catalog_manager.cc:4841] TS 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433): tablet b1478bea578c4973b590f461179b9ec3 (table test-table [id=23f1512ed0e8410b81ae80e6fb9010e7]) successfully deleted
I20260620 22:03:29.627317 3524 raft_consensus.cc:2229] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:29.627350 3480 tablet_bootstrap.cc:492] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: No bootstrap required, opened a new log
I20260620 22:03:29.627345 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 31d1b06ca8fb4906b09555d8a5bc193a (DEFAULT_TABLE table=test-table [id=b63ee59bfcfa4073b5a5d4d99115f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:29.627358 3524 raft_consensus.cc:2258] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:29.627403 3480 ts_tablet_manager.cc:1397] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:29.627475 3394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d1b06ca8fb4906b09555d8a5bc193a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.627538 3480 raft_consensus.cc:348] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.627589 3480 raft_consensus.cc:374] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.627609 3480 raft_consensus.cc:729] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fd45997fde49fdbd9ee9b961128e03, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.627647 3480 consensus_queue.cc:260] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.627718 3480 ts_tablet_manager.cc:1428] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.628047 3524 ts_tablet_manager.cc:1905] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:29.628697 3481 tablet_bootstrap.cc:492] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: Bootstrap starting.
I20260620 22:03:29.628839 2962 catalog_manager.cc:4841] TS 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381): tablet b1478bea578c4973b590f461179b9ec3 (table test-table [id=23f1512ed0e8410b81ae80e6fb9010e7]) successfully deleted
I20260620 22:03:29.629060 3114 tablet_service.cc:1467] Processing CreateTablet for tablet 31d1b06ca8fb4906b09555d8a5bc193a (DEFAULT_TABLE table=test-table [id=b63ee59bfcfa4073b5a5d4d99115f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:29.629076 3481 tablet_bootstrap.cc:654] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.629158 3114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d1b06ca8fb4906b09555d8a5bc193a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:29.629709 3481 tablet_bootstrap.cc:492] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: No bootstrap required, opened a new log
I20260620 22:03:29.629751 3481 ts_tablet_manager.cc:1397] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:29.629889 3481 raft_consensus.cc:348] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.629940 3481 raft_consensus.cc:374] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.629959 3481 raft_consensus.cc:729] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d347c661115549659767f5301d523d0c, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.629997 3481 consensus_queue.cc:260] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.630069 3481 ts_tablet_manager.cc:1428] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.630340 3482 tablet_bootstrap.cc:492] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: Bootstrap starting.
I20260620 22:03:29.630650 3482 tablet_bootstrap.cc:654] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:29.631166 3482 tablet_bootstrap.cc:492] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: No bootstrap required, opened a new log
I20260620 22:03:29.631209 3482 ts_tablet_manager.cc:1397] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:29.631311 3482 raft_consensus.cc:348] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.631361 3482 raft_consensus.cc:374] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:29.631378 3482 raft_consensus.cc:729] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fb5701d780746ebb6fd94c91f56b8d1, State: Initialized, Role: FOLLOWER
I20260620 22:03:29.631374 3524 ts_tablet_manager.cc:1918] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:29.631426 3482 consensus_queue.cc:260] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.631446 3524 log.cc:1196] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/b1478bea578c4973b590f461179b9ec3
I20260620 22:03:29.631494 3482 ts_tablet_manager.cc:1428] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:29.631968 3524 ts_tablet_manager.cc:1939] T b1478bea578c4973b590f461179b9ec3 P d347c661115549659767f5301d523d0c: Deleting consensus metadata
I20260620 22:03:29.632354 2963 catalog_manager.cc:4841] TS d347c661115549659767f5301d523d0c (127.1.55.195:41417): tablet b1478bea578c4973b590f461179b9ec3 (table test-table [id=23f1512ed0e8410b81ae80e6fb9010e7]) successfully deleted
I20260620 22:03:29.685285 3487 raft_consensus.cc:482] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:29.685375 3487 raft_consensus.cc:504] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.685701 3487 leader_election.cc:288] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381), d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:29.688863 3530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.685861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41381 (local address 127.1.55.194:53043)
0620 22:03:29.685991 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.685999 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.686036 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.686196 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.686196 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.686198 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.686246 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.686248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.687050 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.687051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.688094 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.688096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.688642 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.688643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.688709 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.688713 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.688759 (+ 46us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.688803 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":58,"threads_started":1}
I20260620 22:03:29.688858 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.686046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:53043 (local address 127.1.55.193:41381)
0620 22:03:29.686081 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.686083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.686089 (+ 6us) server_negotiation.cc:407] Connection header received
0620 22:03:29.686112 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.686112 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.686121 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.686180 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.686324 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.686961 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.688183 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.688541 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.688634 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.688643 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.688765 (+ 122us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.688802 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:03:29.688915 3477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.685902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:52419 (local address 127.1.55.195:41417)
0620 22:03:29.686006 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.686008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.686017 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:29.686105 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.686106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.686116 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.686147 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:29.686337 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.686764 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.688054 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.688591 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.688684 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.688692 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.688818 (+ 126us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.688854 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260620 22:03:29.689105 3529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.685850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:41417 (local address 127.1.55.194:52419)
0620 22:03:29.685952 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.685962 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.686015 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.686219 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.686219 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.686220 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:29.686268 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.686269 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.686833 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.686833 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.687950 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.687952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.688692 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.688693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.688746 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.688749 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.688978 (+ 229us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.689019 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":42,"threads_started":1}
I20260620 22:03:29.689219 3134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d1b06ca8fb4906b09555d8a5bc193a" candidate_uuid: "14fd45997fde49fdbd9ee9b961128e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" is_pre_election: true
I20260620 22:03:29.689307 3134 raft_consensus.cc:2454] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fd45997fde49fdbd9ee9b961128e03 in term 0.
I20260620 22:03:29.689293 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d1b06ca8fb4906b09555d8a5bc193a" candidate_uuid: "14fd45997fde49fdbd9ee9b961128e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c" is_pre_election: true
I20260620 22:03:29.689370 3413 raft_consensus.cc:2454] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fd45997fde49fdbd9ee9b961128e03 in term 0.
I20260620 22:03:29.689492 3206 leader_election.cc:302] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, 14fd45997fde49fdbd9ee9b961128e03; no voters:
I20260620 22:03:29.689599 3487 raft_consensus.cc:2781] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:29.689633 3487 raft_consensus.cc:482] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:29.689678 3487 raft_consensus.cc:3037] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.690250 3487 raft_consensus.cc:504] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.690363 3487 leader_election.cc:288] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [CANDIDATE]: Term 1 election: Requested vote from peers 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381), d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:29.690508 3134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d1b06ca8fb4906b09555d8a5bc193a" candidate_uuid: "14fd45997fde49fdbd9ee9b961128e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fb5701d780746ebb6fd94c91f56b8d1"
I20260620 22:03:29.690528 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d1b06ca8fb4906b09555d8a5bc193a" candidate_uuid: "14fd45997fde49fdbd9ee9b961128e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c"
I20260620 22:03:29.690589 3413 raft_consensus.cc:3037] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.690591 3134 raft_consensus.cc:3037] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:29.691100 3134 raft_consensus.cc:2454] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fd45997fde49fdbd9ee9b961128e03 in term 1.
I20260620 22:03:29.691241 3206 leader_election.cc:302] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, 14fd45997fde49fdbd9ee9b961128e03; no voters:
I20260620 22:03:29.691310 3487 raft_consensus.cc:2781] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:29.691304 3413 raft_consensus.cc:2454] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fd45997fde49fdbd9ee9b961128e03 in term 1.
I20260620 22:03:29.691409 3487 raft_consensus.cc:686] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 1 LEADER]: Becoming Leader. State: Replica: 14fd45997fde49fdbd9ee9b961128e03, State: Running, Role: LEADER
I20260620 22:03:29.691466 3487 consensus_queue.cc:237] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:29.691994 2976 catalog_manager.cc:5495] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "14fd45997fde49fdbd9ee9b961128e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } health_report { overall_health: UNKNOWN } } }
I20260620 22:03:29.703053 3491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.700444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54518 (local address 127.1.55.194:34433)
0620 22:03:29.700475 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.700477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.700486 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:29.700599 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.700600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.700628 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.700711 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:29.700834 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.701497 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.702472 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.702630 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.702678 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.702809 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.702889 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.702937 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.702986 (+ 49us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.702998 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:03:29.707366 3478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.705157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:50411 (local address 127.1.55.193:41381)
0620 22:03:29.705202 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.705204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.705328 (+ 124us) server_negotiation.cc:407] Connection header received
0620 22:03:29.705375 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.705376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.705385 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.705423 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:29.705536 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.705922 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.706802 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.706961 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.707005 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.707158 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.707178 (+ 20us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.707237 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.707296 (+ 59us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.707311 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 22:03:29.707472 3535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.705071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41381 (local address 127.1.55.194:50411)
0620 22:03:29.705263 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.705271 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.705325 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.705432 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.705433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.705433 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:03:29.705466 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.705467 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.706003 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.706004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.706730 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.706732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.707031 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.707032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.707077 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.707088 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.707240 (+ 152us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.707243 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.707292 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.707327 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":98,"threads_started":1}
I20260620 22:03:29.709211 3134 raft_consensus.cc:1261] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Refusing update from remote peer 14fd45997fde49fdbd9ee9b961128e03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:29.709237 3413 raft_consensus.cc:1261] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Refusing update from remote peer 14fd45997fde49fdbd9ee9b961128e03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:29.709451 3487 consensus_queue.cc:1035] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:29.709561 3531 consensus_queue.cc:1035] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:29.717336 3519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.714897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34433 (local address 127.1.55.193:39019)
0620 22:03:29.714944 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:29.714954 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:29.714997 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:29.715177 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:29.715178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:29.715179 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:03:29.715211 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.715212 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.715993 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.715993 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.716653 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:29.716655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.717095 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.717095 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:29.717126 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.717131 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.717242 (+ 111us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.717243 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:03:29.717271 (+ 28us) client_negotiation.cc:240] Negotiation successful
0620 22:03:29.717296 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260620 22:03:29.717347 3491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:29.714954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:39019 (local address 127.1.55.194:34433)
0620 22:03:29.714985 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:29.714986 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:29.714994 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:03:29.715096 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:29.715097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:29.715106 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:29.715144 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:29.715263 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.715915 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.716747 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:29.717004 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:29.717088 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:29.717172 (+ 84us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:29.717197 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:29.717241 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:29.717277 (+ 36us) server_negotiation.cc:299] Negotiation successful
0620 22:03:29.717293 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
W20260620 22:03:29.717635 3510 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260620 22:03:31.236418 2976 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:31.236506 2976 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:31.237296 2976 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: Sending DeleteTablet for 3 replicas of tablet 31d1b06ca8fb4906b09555d8a5bc193a
I20260620 22:03:31.237561 3113 tablet_service.cc:1514] Processing DeleteTablet for tablet 31d1b06ca8fb4906b09555d8a5bc193a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:31 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:44294
I20260620 22:03:31.237630 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet 31d1b06ca8fb4906b09555d8a5bc193a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:31 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:54510
I20260620 22:03:31.237778 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 31d1b06ca8fb4906b09555d8a5bc193a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:31 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36688
I20260620 22:03:31.238010 3563 tablet_replica.cc:330] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: stopping tablet replica
I20260620 22:03:31.238060 3563 raft_consensus.cc:2229] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:03:31.238131 3563 raft_consensus.cc:2258] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:31.238334 3563 ts_tablet_manager.cc:1905] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:31.238808 3564 tablet_replica.cc:330] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: stopping tablet replica
I20260620 22:03:31.238854 3564 raft_consensus.cc:2229] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:31.238881 3564 raft_consensus.cc:2258] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:31.239100 3564 ts_tablet_manager.cc:1905] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:31.240198 3563 ts_tablet_manager.cc:1918] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 22:03:31.240270 3563 log.cc:1196] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/31d1b06ca8fb4906b09555d8a5bc193a
I20260620 22:03:31.240514 3563 ts_tablet_manager.cc:1939] T 31d1b06ca8fb4906b09555d8a5bc193a P 14fd45997fde49fdbd9ee9b961128e03: Deleting consensus metadata
I20260620 22:03:31.240819 3564 ts_tablet_manager.cc:1918] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 22:03:31.240885 3564 log.cc:1196] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/31d1b06ca8fb4906b09555d8a5bc193a
I20260620 22:03:31.240867 2964 catalog_manager.cc:4841] TS 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433): tablet 31d1b06ca8fb4906b09555d8a5bc193a (table test-table [id=b63ee59bfcfa4073b5a5d4d99115f225]) successfully deleted
I20260620 22:03:31.241144 3564 ts_tablet_manager.cc:1939] T 31d1b06ca8fb4906b09555d8a5bc193a P d347c661115549659767f5301d523d0c: Deleting consensus metadata
I20260620 22:03:31.241407 2963 catalog_manager.cc:4841] TS d347c661115549659767f5301d523d0c (127.1.55.195:41417): tablet 31d1b06ca8fb4906b09555d8a5bc193a (table test-table [id=b63ee59bfcfa4073b5a5d4d99115f225]) successfully deleted
I20260620 22:03:31.241609 3562 tablet_replica.cc:330] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: stopping tablet replica
I20260620 22:03:31.241681 3562 raft_consensus.cc:2229] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:31.241736 3562 raft_consensus.cc:2258] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:31.241950 3562 ts_tablet_manager.cc:1905] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:31.243105 3562 ts_tablet_manager.cc:1918] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 22:03:31.243177 3562 log.cc:1196] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/31d1b06ca8fb4906b09555d8a5bc193a
I20260620 22:03:31.243364 3562 ts_tablet_manager.cc:1939] T 31d1b06ca8fb4906b09555d8a5bc193a P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting consensus metadata
I20260620 22:03:31.243631 2962 catalog_manager.cc:4841] TS 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381): tablet 31d1b06ca8fb4906b09555d8a5bc193a (table test-table [id=b63ee59bfcfa4073b5a5d4d99115f225]) successfully deleted
Jun 20 22:03:31 dist-test-slave-xw35 krb5kdc[2932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993011, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 22:03:31 dist-test-slave-xw35 krb5kdc[2932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993011, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:31.260231 3572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:31.253891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39840 (local address 127.1.55.254:33237)
0620 22:03:31.254019 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:31.254021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:31.254066 (+ 45us) server_negotiation.cc:407] Connection header received
0620 22:03:31.254154 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:31.254155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:31.254167 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:31.254239 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:31.254894 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:31.255380 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:31.256077 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:31.256244 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:31.256288 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:31.258146 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:31.258147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:31.258147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:31.258153 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:31.259254 (+ 1101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:31.259565 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:31.259566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:31.259566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:31.259624 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:31.259788 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:31.259789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:31.259789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:31.259881 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:31.259950 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:31.260053 (+ 103us) server_negotiation.cc:299] Negotiation successful
0620 22:03:31.260130 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":58,"threads_started":1}
I20260620 22:03:31.261437 2976 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:31.261626 2976 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:31.262676 3113 tablet_service.cc:1467] Processing CreateTablet for tablet 8da58b0e4f274db7b3f3f35aa8f46e31 (DEFAULT_TABLE table=test-table [id=a5be9e9c508340bba9c089344ee853a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:31.262691 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 8da58b0e4f274db7b3f3f35aa8f46e31 (DEFAULT_TABLE table=test-table [id=a5be9e9c508340bba9c089344ee853a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:31.262780 3394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8da58b0e4f274db7b3f3f35aa8f46e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:31.262781 3113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8da58b0e4f274db7b3f3f35aa8f46e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:31.263939 3573 tablet_bootstrap.cc:492] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: Bootstrap starting.
I20260620 22:03:31.264027 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 8da58b0e4f274db7b3f3f35aa8f46e31 (DEFAULT_TABLE table=test-table [id=a5be9e9c508340bba9c089344ee853a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:31.264153 3254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8da58b0e4f274db7b3f3f35aa8f46e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:31.264190 3574 tablet_bootstrap.cc:492] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: Bootstrap starting.
I20260620 22:03:31.264340 3573 tablet_bootstrap.cc:654] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:31.264496 3574 tablet_bootstrap.cc:654] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:31.265038 3574 tablet_bootstrap.cc:492] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: No bootstrap required, opened a new log
I20260620 22:03:31.265089 3574 ts_tablet_manager.cc:1397] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:31.265178 3574 raft_consensus.cc:348] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.265275 3574 raft_consensus.cc:374] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:31.265295 3574 raft_consensus.cc:729] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fb5701d780746ebb6fd94c91f56b8d1, State: Initialized, Role: FOLLOWER
I20260620 22:03:31.265365 3574 consensus_queue.cc:260] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.265470 3577 tablet_bootstrap.cc:492] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: Bootstrap starting.
I20260620 22:03:31.265590 3574 ts_tablet_manager.cc:1428] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:31.265869 3577 tablet_bootstrap.cc:654] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:31.266043 3573 tablet_bootstrap.cc:492] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: No bootstrap required, opened a new log
I20260620 22:03:31.266090 3573 ts_tablet_manager.cc:1397] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:31.266206 3573 raft_consensus.cc:348] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.266264 3573 raft_consensus.cc:374] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:31.266292 3573 raft_consensus.cc:729] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d347c661115549659767f5301d523d0c, State: Initialized, Role: FOLLOWER
I20260620 22:03:31.266337 3573 consensus_queue.cc:260] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.266474 3573 ts_tablet_manager.cc:1428] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:31.266871 3577 tablet_bootstrap.cc:492] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: No bootstrap required, opened a new log
I20260620 22:03:31.266919 3577 ts_tablet_manager.cc:1397] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:31.267007 3577 raft_consensus.cc:348] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.267067 3577 raft_consensus.cc:374] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:31.267091 3577 raft_consensus.cc:729] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fd45997fde49fdbd9ee9b961128e03, State: Initialized, Role: FOLLOWER
I20260620 22:03:31.267148 3577 consensus_queue.cc:260] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.267239 3577 ts_tablet_manager.cc:1428] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:31.270565 3543 raft_consensus.cc:482] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:31.270624 3543 raft_consensus.cc:504] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.270735 3543 leader_election.cc:288] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433), d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:31.270852 3273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8da58b0e4f274db7b3f3f35aa8f46e31" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fd45997fde49fdbd9ee9b961128e03" is_pre_election: true
I20260620 22:03:31.270925 3273 raft_consensus.cc:2454] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 0.
I20260620 22:03:31.271006 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8da58b0e4f274db7b3f3f35aa8f46e31" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c" is_pre_election: true
I20260620 22:03:31.271072 3414 raft_consensus.cc:2454] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 0.
I20260620 22:03:31.271068 3068 leader_election.cc:302] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, 14fd45997fde49fdbd9ee9b961128e03; no voters:
I20260620 22:03:31.271144 3543 raft_consensus.cc:2781] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:31.271178 3543 raft_consensus.cc:482] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:31.271205 3543 raft_consensus.cc:3037] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:31.271677 3543 raft_consensus.cc:504] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.271790 3543 leader_election.cc:288] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 election: Requested vote from peers 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433), d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:31.271890 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8da58b0e4f274db7b3f3f35aa8f46e31" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c"
I20260620 22:03:31.271972 3414 raft_consensus.cc:3037] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:31.271947 3273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8da58b0e4f274db7b3f3f35aa8f46e31" candidate_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fd45997fde49fdbd9ee9b961128e03"
I20260620 22:03:31.272001 3273 raft_consensus.cc:3037] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:31.272977 3273 raft_consensus.cc:2454] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 1.
I20260620 22:03:31.272977 3414 raft_consensus.cc:2454] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fb5701d780746ebb6fd94c91f56b8d1 in term 1.
I20260620 22:03:31.273114 3067 leader_election.cc:302] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, d347c661115549659767f5301d523d0c; no voters:
I20260620 22:03:31.273188 3543 raft_consensus.cc:2781] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:31.273228 3543 raft_consensus.cc:686] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 LEADER]: Becoming Leader. State: Replica: 0fb5701d780746ebb6fd94c91f56b8d1, State: Running, Role: LEADER
I20260620 22:03:31.273272 3543 consensus_queue.cc:237] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.273643 2976 catalog_manager.cc:5495] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } health_report { overall_health: UNKNOWN } } }
I20260620 22:03:31.280740 3582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:31.278588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.1.55.193:41381)
0620 22:03:31.278672 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:31.278673 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:31.278678 (+ 5us) server_negotiation.cc:407] Connection header received
0620 22:03:31.278692 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:31.278693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:31.278700 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:31.278766 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:31.278860 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:31.279347 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:31.280082 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:31.280289 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:31.280355 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:31.280488 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:31.280520 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:31.280571 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:31.280628 (+ 57us) server_negotiation.cc:299] Negotiation successful
0620 22:03:31.280646 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65,"thread_start_us":49,"threads_started":1}
I20260620 22:03:31.282526 3414 raft_consensus.cc:1261] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Refusing update from remote peer 0fb5701d780746ebb6fd94c91f56b8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:31.282541 3273 raft_consensus.cc:1261] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Refusing update from remote peer 0fb5701d780746ebb6fd94c91f56b8d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:31.282702 3486 consensus_queue.cc:1035] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:31.282769 3543 consensus_queue.cc:1035] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:31.283638 3541 mvcc.cc:205] Tried to move back new op lower bound from 7299043374212292608 to 7299043374175535104. Current Snapshot: MvccSnapshot[applied={T|T < 7299043374212292608}]
I20260620 22:03:31.294384 2977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:31.294443 2977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:31.294836 2977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: Sending DeleteTablet for 3 replicas of tablet 8da58b0e4f274db7b3f3f35aa8f46e31
I20260620 22:03:31.295145 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 8da58b0e4f274db7b3f3f35aa8f46e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:31 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36688
I20260620 22:03:31.295146 3113 tablet_service.cc:1514] Processing DeleteTablet for tablet 8da58b0e4f274db7b3f3f35aa8f46e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:31 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:44294
I20260620 22:03:31.295233 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet 8da58b0e4f274db7b3f3f35aa8f46e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:31 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:54510
I20260620 22:03:31.295235 3562 tablet_replica.cc:330] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: stopping tablet replica
I20260620 22:03:31.295302 3562 raft_consensus.cc:2229] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:03:31.295246 2977 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 22:03:31.295331 3563 tablet_replica.cc:330] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: stopping tablet replica
I20260620 22:03:31.295344 3562 raft_consensus.cc:2258] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 22:03:31.295359 2977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:31.295385 3563 raft_consensus.cc:2229] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:31.295404 3564 tablet_replica.cc:330] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: stopping tablet replica
I20260620 22:03:31.295419 3563 raft_consensus.cc:2258] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:31.295451 3564 raft_consensus.cc:2229] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:31.295485 3564 raft_consensus.cc:2258] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:31.295746 3563 ts_tablet_manager.cc:1905] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:31.295746 3562 ts_tablet_manager.cc:1905] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:31.295823 3564 ts_tablet_manager.cc:1905] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:31.296927 3564 ts_tablet_manager.cc:1918] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:31.297006 3564 log.cc:1196] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/8da58b0e4f274db7b3f3f35aa8f46e31
I20260620 22:03:31.297186 3563 ts_tablet_manager.cc:1918] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:31.297235 3563 log.cc:1196] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/8da58b0e4f274db7b3f3f35aa8f46e31
I20260620 22:03:31.297251 3564 ts_tablet_manager.cc:1939] T 8da58b0e4f274db7b3f3f35aa8f46e31 P d347c661115549659767f5301d523d0c: Deleting consensus metadata
I20260620 22:03:31.297461 3563 ts_tablet_manager.cc:1939] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 14fd45997fde49fdbd9ee9b961128e03: Deleting consensus metadata
I20260620 22:03:31.297564 2963 catalog_manager.cc:4841] TS d347c661115549659767f5301d523d0c (127.1.55.195:41417): tablet 8da58b0e4f274db7b3f3f35aa8f46e31 (table test-table [id=a5be9e9c508340bba9c089344ee853a1]) successfully deleted
I20260620 22:03:31.297793 2964 catalog_manager.cc:4841] TS 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433): tablet 8da58b0e4f274db7b3f3f35aa8f46e31 (table test-table [id=a5be9e9c508340bba9c089344ee853a1]) successfully deleted
I20260620 22:03:31.297916 3562 ts_tablet_manager.cc:1918] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:03:31.297966 3562 log.cc:1196] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/8da58b0e4f274db7b3f3f35aa8f46e31
I20260620 22:03:31.298177 3562 ts_tablet_manager.cc:1939] T 8da58b0e4f274db7b3f3f35aa8f46e31 P 0fb5701d780746ebb6fd94c91f56b8d1: Deleting consensus metadata
I20260620 22:03:31.298225 3113 tablet_service.cc:1467] Processing CreateTablet for tablet 437d360b06ea430abc27537ced5754e5 (DEFAULT_TABLE table=test-table [id=9326ba82df7045e7854abfe51d73160b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:31.298254 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 437d360b06ea430abc27537ced5754e5 (DEFAULT_TABLE table=test-table [id=9326ba82df7045e7854abfe51d73160b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:31.298324 3394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 437d360b06ea430abc27537ced5754e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:31.298326 3113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 437d360b06ea430abc27537ced5754e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:31.298420 2962 catalog_manager.cc:4841] TS 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381): tablet 8da58b0e4f274db7b3f3f35aa8f46e31 (table test-table [id=a5be9e9c508340bba9c089344ee853a1]) successfully deleted
I20260620 22:03:31.299296 3573 tablet_bootstrap.cc:492] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: Bootstrap starting.
I20260620 22:03:31.299312 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 437d360b06ea430abc27537ced5754e5 (DEFAULT_TABLE table=test-table [id=9326ba82df7045e7854abfe51d73160b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:31.299412 3254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 437d360b06ea430abc27537ced5754e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:31.299410 3574 tablet_bootstrap.cc:492] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1: Bootstrap starting.
I20260620 22:03:31.299593 3573 tablet_bootstrap.cc:654] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:31.299696 3574 tablet_bootstrap.cc:654] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:31.300156 3573 tablet_bootstrap.cc:492] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: No bootstrap required, opened a new log
I20260620 22:03:31.300194 3573 ts_tablet_manager.cc:1397] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:31.300165 3574 tablet_bootstrap.cc:492] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1: No bootstrap required, opened a new log
I20260620 22:03:31.300282 3573 raft_consensus.cc:348] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.300323 3573 raft_consensus.cc:374] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:31.300336 3573 raft_consensus.cc:729] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d347c661115549659767f5301d523d0c, State: Initialized, Role: FOLLOWER
I20260620 22:03:31.300302 3574 ts_tablet_manager.cc:1397] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:31.300391 3573 consensus_queue.cc:260] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.300479 3577 tablet_bootstrap.cc:492] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: Bootstrap starting.
I20260620 22:03:31.300501 3573 ts_tablet_manager.cc:1428] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:31.300608 3574 raft_consensus.cc:348] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.300724 3574 raft_consensus.cc:374] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:31.300787 3577 tablet_bootstrap.cc:654] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:31.300791 3574 raft_consensus.cc:729] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fb5701d780746ebb6fd94c91f56b8d1, State: Initialized, Role: FOLLOWER
I20260620 22:03:31.300864 3574 consensus_queue.cc:260] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.300964 3574 ts_tablet_manager.cc:1428] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:31.301355 3577 tablet_bootstrap.cc:492] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: No bootstrap required, opened a new log
I20260620 22:03:31.301414 3577 ts_tablet_manager.cc:1397] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:31.301537 3577 raft_consensus.cc:348] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.301605 3577 raft_consensus.cc:374] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:31.301628 3577 raft_consensus.cc:729] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fd45997fde49fdbd9ee9b961128e03, State: Initialized, Role: FOLLOWER
I20260620 22:03:31.301662 3577 consensus_queue.cc:260] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.301749 3577 ts_tablet_manager.cc:1428] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:31.376814 3556 raft_consensus.cc:482] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:31.376873 3556 raft_consensus.cc:504] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.377019 3556 leader_election.cc:288] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381), d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:31.377166 3134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "437d360b06ea430abc27537ced5754e5" candidate_uuid: "14fd45997fde49fdbd9ee9b961128e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" is_pre_election: true
I20260620 22:03:31.377269 3134 raft_consensus.cc:2454] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fd45997fde49fdbd9ee9b961128e03 in term 0.
I20260620 22:03:31.377262 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "437d360b06ea430abc27537ced5754e5" candidate_uuid: "14fd45997fde49fdbd9ee9b961128e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c" is_pre_election: true
I20260620 22:03:31.377324 3414 raft_consensus.cc:2454] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fd45997fde49fdbd9ee9b961128e03 in term 0.
I20260620 22:03:31.377436 3206 leader_election.cc:302] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fb5701d780746ebb6fd94c91f56b8d1, 14fd45997fde49fdbd9ee9b961128e03; no voters:
I20260620 22:03:31.377561 3556 raft_consensus.cc:2781] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:31.377607 3556 raft_consensus.cc:482] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:31.377619 3556 raft_consensus.cc:3037] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:31.378170 3556 raft_consensus.cc:504] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.378293 3556 leader_election.cc:288] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [CANDIDATE]: Term 1 election: Requested vote from peers 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381), d347c661115549659767f5301d523d0c (127.1.55.195:41417)
I20260620 22:03:31.378425 3134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "437d360b06ea430abc27537ced5754e5" candidate_uuid: "14fd45997fde49fdbd9ee9b961128e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fb5701d780746ebb6fd94c91f56b8d1"
I20260620 22:03:31.378444 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "437d360b06ea430abc27537ced5754e5" candidate_uuid: "14fd45997fde49fdbd9ee9b961128e03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d347c661115549659767f5301d523d0c"
I20260620 22:03:31.378501 3134 raft_consensus.cc:3037] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:31.378543 3414 raft_consensus.cc:3037] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:31.379068 3414 raft_consensus.cc:2454] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fd45997fde49fdbd9ee9b961128e03 in term 1.
I20260620 22:03:31.379086 3134 raft_consensus.cc:2454] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fd45997fde49fdbd9ee9b961128e03 in term 1.
I20260620 22:03:31.379232 3207 leader_election.cc:302] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fd45997fde49fdbd9ee9b961128e03, d347c661115549659767f5301d523d0c; no voters:
I20260620 22:03:31.379312 3556 raft_consensus.cc:2781] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:31.379361 3556 raft_consensus.cc:686] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 LEADER]: Becoming Leader. State: Replica: 14fd45997fde49fdbd9ee9b961128e03, State: Running, Role: LEADER
I20260620 22:03:31.379406 3556 consensus_queue.cc:237] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } }
I20260620 22:03:31.379935 2976 catalog_manager.cc:5495] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "14fd45997fde49fdbd9ee9b961128e03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14fd45997fde49fdbd9ee9b961128e03" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 } health_report { overall_health: UNKNOWN } } }
I20260620 22:03:31.394989 3590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:31.393072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54520 (local address 127.1.55.194:34433)
0620 22:03:31.393202 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:31.393204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:31.393211 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:03:31.393229 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:31.393230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:31.393240 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:31.393298 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:31.393383 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:31.393834 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:31.394485 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:31.394665 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:31.394713 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:31.394820 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:31.394842 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:31.394877 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:31.394927 (+ 50us) server_negotiation.cc:299] Negotiation successful
0620 22:03:31.394941 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":95,"threads_started":1}
I20260620 22:03:31.396920 3414 raft_consensus.cc:1261] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Refusing update from remote peer 14fd45997fde49fdbd9ee9b961128e03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:31.396946 3134 raft_consensus.cc:1261] T 437d360b06ea430abc27537ced5754e5 P 0fb5701d780746ebb6fd94c91f56b8d1 [term 1 FOLLOWER]: Refusing update from remote peer 14fd45997fde49fdbd9ee9b961128e03: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:31.397085 3553 consensus_queue.cc:1035] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fb5701d780746ebb6fd94c91f56b8d1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:31.397164 3556 consensus_queue.cc:1035] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d347c661115549659767f5301d523d0c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 22:03:31.400970 3545 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260620 22:03:32.916366 2977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:32.916469 2977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:32.917198 2977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e694459d727e4c5a9aa14eaf6cf3b422: Sending DeleteTablet for 3 replicas of tablet 437d360b06ea430abc27537ced5754e5
I20260620 22:03:32.917497 3113 tablet_service.cc:1514] Processing DeleteTablet for tablet 437d360b06ea430abc27537ced5754e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:32 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:44294
I20260620 22:03:32.917495 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 437d360b06ea430abc27537ced5754e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:32 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36688
I20260620 22:03:32.917531 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet 437d360b06ea430abc27537ced5754e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:32 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:54510
I20260620 22:03:32.917716 3617 tablet_replica.cc:330] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: stopping tablet replica
I20260620 22:03:32.917778 3617 raft_consensus.cc:2229] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:03:32.917773 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 3049
I20260620 22:03:32.917856 3617 raft_consensus.cc:2258] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:32.918798 3617 ts_tablet_manager.cc:1905] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:32.919245 3615 tablet_replica.cc:330] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: stopping tablet replica
I20260620 22:03:32.919322 3615 raft_consensus.cc:2229] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:32.919361 3615 raft_consensus.cc:2258] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:32.919577 3615 ts_tablet_manager.cc:1905] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:32.920653 3617 ts_tablet_manager.cc:1918] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 22:03:32.920713 3617 log.cc:1196] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/437d360b06ea430abc27537ced5754e5
I20260620 22:03:32.920787 3615 ts_tablet_manager.cc:1918] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260620 22:03:32.920873 3615 log.cc:1196] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/437d360b06ea430abc27537ced5754e5
I20260620 22:03:32.920948 3617 ts_tablet_manager.cc:1939] T 437d360b06ea430abc27537ced5754e5 P 14fd45997fde49fdbd9ee9b961128e03: Deleting consensus metadata
I20260620 22:03:32.921165 3615 ts_tablet_manager.cc:1939] T 437d360b06ea430abc27537ced5754e5 P d347c661115549659767f5301d523d0c: Deleting consensus metadata
I20260620 22:03:32.921299 2964 catalog_manager.cc:4841] TS 14fd45997fde49fdbd9ee9b961128e03 (127.1.55.194:34433): tablet 437d360b06ea430abc27537ced5754e5 (table test-table [id=9326ba82df7045e7854abfe51d73160b]) successfully deleted
I20260620 22:03:32.921487 2963 catalog_manager.cc:4841] TS d347c661115549659767f5301d523d0c (127.1.55.195:41417): tablet 437d360b06ea430abc27537ced5754e5 (table test-table [id=9326ba82df7045e7854abfe51d73160b]) successfully deleted
W20260620 22:03:32.925048 2962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:41381 (error 108)
I20260620 22:03:32.925240 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 3189
I20260620 22:03:32.925989 3619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:32.925399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41381 (local address 127.0.0.1:44988)
0620 22:03:32.925896 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:32.925945 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:41381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":53,"threads_started":1}
W20260620 22:03:32.926254 2962 catalog_manager.cc:4584] TS 0fb5701d780746ebb6fd94c91f56b8d1 (127.1.55.193:41381): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 437d360b06ea430abc27537ced5754e5: Network error: Client connection negotiation failed: client connection to 127.1.55.193:41381: connect: Connection refused (error 111)
I20260620 22:03:32.930968 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 3329
I20260620 22:03:32.935464 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 2945
2026-06-20T22:03:32Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5300 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:32 dist-test-slave-xw35 krb5kdc[3622](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:32 dist-test-slave-xw35 krb5kdc[3622](info): set up 2 sockets
Jun 20 22:03:32 dist-test-slave-xw35 krb5kdc[3622](info): commencing operation
krb5kdc: starting...
W20260620 22:03:33.913115 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.958s user 0.000s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:33 dist-test-slave-xw35 krb5kdc[3622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:34.015381 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:36109
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:36109
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:34.088284 3635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:34.088459 3635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:34.088480 3635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:34.089452 3635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:34.089527 3635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:34.089570 3635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:34.089583 3635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:34.089594 3635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:34.090965 3635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:36109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:36109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:34.091120 3635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:34.091259 3635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:34.095526 3641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:34.095527 3640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:34.095629 3635 server_base.cc:1034] running on GCE node
W20260620 22:03:34.095686 3643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:34.095974 3635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:34.096171 3635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:34.097298 3635 hybrid_clock.cc:648] HybridClock initialized: now 1781993014097281 us; error 33 us; skew 500 ppm
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[3622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:34.099550 3635 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:34.099957 3635 webserver.cc:460] Webserver started at http://127.1.55.254:34819/ using document root <none> and password file <none>
I20260620 22:03:34.100165 3635 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:34.100225 3635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:34.100356 3635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:34.101212 3635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "504690e8800341a5812fdb870238a9ce"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "66b1108b23aebb6c7889a73c00af4546"
server_key_iv: "e325c0a9e4340856cf0303a35b1fab50"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.101611 3635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "504690e8800341a5812fdb870238a9ce"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "66b1108b23aebb6c7889a73c00af4546"
server_key_iv: "e325c0a9e4340856cf0303a35b1fab50"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.102741 3635 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:34.103320 3650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.103456 3635 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:34.103547 3635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "504690e8800341a5812fdb870238a9ce"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "66b1108b23aebb6c7889a73c00af4546"
server_key_iv: "e325c0a9e4340856cf0303a35b1fab50"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.103623 3635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:34.110261 3635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:34.112219 3635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:34.112354 3635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:34.116050 3635 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:36109
I20260620 22:03:34.116075 3702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:36109 every 8 connection(s)
I20260620 22:03:34.116350 3635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:34.117025 3703 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:34.118875 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 3635
I20260620 22:03:34.118959 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:34.119005 3703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce: Bootstrap starting.
I20260620 22:03:34.119117 1247 external_mini_cluster.cc:1428] Setting key 4c9b3aa10984914652a38d162a856f6c
I20260620 22:03:34.119655 3703 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:34.119932 3703 log.cc:824] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:34.120642 3703 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce: No bootstrap required, opened a new log
I20260620 22:03:34.122758 3703 raft_consensus.cc:348] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504690e8800341a5812fdb870238a9ce" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36109 } }
I20260620 22:03:34.122910 3703 raft_consensus.cc:374] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:34.122936 3703 raft_consensus.cc:729] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504690e8800341a5812fdb870238a9ce, State: Initialized, Role: FOLLOWER
I20260620 22:03:34.123034 3703 consensus_queue.cc:260] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504690e8800341a5812fdb870238a9ce" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36109 } }
I20260620 22:03:34.123106 3703 raft_consensus.cc:388] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:34.123133 3703 raft_consensus.cc:482] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:34.123224 3703 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:34.123749 3703 raft_consensus.cc:504] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504690e8800341a5812fdb870238a9ce" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36109 } }
I20260620 22:03:34.123850 3703 leader_election.cc:302] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 504690e8800341a5812fdb870238a9ce; no voters:
I20260620 22:03:34.124104 3703 leader_election.cc:288] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:34.124205 3708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:34.124387 3703 sys_catalog.cc:564] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:34.124421 3708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [term 1 LEADER]: Becoming Leader. State: Replica: 504690e8800341a5812fdb870238a9ce, State: Running, Role: LEADER
I20260620 22:03:34.124608 3708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504690e8800341a5812fdb870238a9ce" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36109 } }
I20260620 22:03:34.124945 3709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "504690e8800341a5812fdb870238a9ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504690e8800341a5812fdb870238a9ce" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36109 } } }
I20260620 22:03:34.125016 3709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:34.125174 3710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 504690e8800341a5812fdb870238a9ce. Latest consensus state: current_term: 1 leader_uuid: "504690e8800341a5812fdb870238a9ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "504690e8800341a5812fdb870238a9ce" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36109 } } }
I20260620 22:03:34.125226 3710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:34.125578 3716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[3622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:34.126004 3716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:34.129604 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:34.119572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52970 (local address 127.1.55.254:36109)
0620 22:03:34.119717 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:34.119726 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:34.119768 (+ 42us) server_negotiation.cc:407] Connection header received
0620 22:03:34.120329 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:34.120337 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:34.120402 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:34.120514 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:34.121285 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.122143 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.123202 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.123617 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.123688 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:34.126489 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:34.126492 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:34.126493 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:34.126503 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:34.128152 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:34.128534 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:34.128536 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:34.128536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:34.128639 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:34.128832 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:34.128833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:34.128833 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:34.129018 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:34.129124 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:34.129243 (+ 119us) server_negotiation.cc:299] Negotiation successful
0620 22:03:34.129328 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":71,"threads_started":1}
I20260620 22:03:34.133175 3716 catalog_manager.cc:1347] Generated new cluster ID: 0f4ae8c0ba314da383e81db1e37ebe0f
I20260620 22:03:34.133232 3716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:34.138237 3716 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:34.138844 3716 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:34.143972 3716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 504690e8800341a5812fdb870238a9ce: Generated new TSK 0
I20260620 22:03:34.144116 3716 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:34.167886 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36109
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:34.241158 3729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:34.241353 3729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:34.241386 3729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:34.242496 3729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:34.242558 3729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:34.242597 3729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:34.243881 3729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:34.244119 3729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:34.244362 3729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:34.248706 3737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:34.248726 3734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:34.248732 3735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:34.249100 3729 server_base.cc:1034] running on GCE node
I20260620 22:03:34.249336 3729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:34.249599 3729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:34.250753 3729 hybrid_clock.cc:648] HybridClock initialized: now 1781993014250744 us; error 37 us; skew 500 ppm
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[3622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:34.253047 3729 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:34.253551 3729 webserver.cc:460] Webserver started at http://127.1.55.193:43999/ using document root <none> and password file <none>
I20260620 22:03:34.253763 3729 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:34.253826 3729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:34.253963 3729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:34.254966 3729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "2a8a9bd7dca34ab9b1c1dfb10ec583d8"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "53a8f5ab669c0cfc71ac59fae1c865b2"
server_key_iv: "f375f76f5d9ccaa776e1dddd96ef00de"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.255318 3729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "2a8a9bd7dca34ab9b1c1dfb10ec583d8"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "53a8f5ab669c0cfc71ac59fae1c865b2"
server_key_iv: "f375f76f5d9ccaa776e1dddd96ef00de"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.256628 3729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:34.257283 3744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.257419 3729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:34.257529 3729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "2a8a9bd7dca34ab9b1c1dfb10ec583d8"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "53a8f5ab669c0cfc71ac59fae1c865b2"
server_key_iv: "f375f76f5d9ccaa776e1dddd96ef00de"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.257606 3729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:34.281112 3729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:34.283136 3729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:34.283288 3729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:34.283484 3729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:34.283756 3729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:34.283807 3729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.283839 3729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:34.283865 3729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.289225 3729 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:42451
I20260620 22:03:34.289271 3857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:42451 every 8 connection(s)
I20260620 22:03:34.289511 3729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:34.291853 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 3729
I20260620 22:03:34.291944 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:34.292093 1247 external_mini_cluster.cc:1428] Setting key 7982df814cb626d65b8673d0cbe24f98
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[3622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:34.298213 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:34.290034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:50807 (local address 127.1.55.254:36109)
0620 22:03:34.290069 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:34.290070 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:34.290254 (+ 184us) server_negotiation.cc:407] Connection header received
0620 22:03:34.290579 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:34.290580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:34.290588 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:34.290629 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:34.291399 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.291952 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.293079 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.293424 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.293529 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:34.295630 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:34.295632 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:34.295632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:34.295639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:34.296937 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:34.297304 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:34.297305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:34.297306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:34.297353 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:34.297622 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:34.297623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:34.297623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:34.297726 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:34.297787 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:34.298047 (+ 260us) server_negotiation.cc:299] Negotiation successful
0620 22:03:34.298131 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:03:34.298334 3860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:34.290026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:36109 (local address 127.1.55.193:50807)
0620 22:03:34.290151 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:34.290178 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:34.290514 (+ 336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:34.290677 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:34.290680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:34.291165 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:34.291330 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:34.291333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.292040 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.292041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:34.292995 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:34.292997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.293568 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.293569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:34.293657 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:34.294130 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:34.294139 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:34.295513 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:34.297028 (+ 1515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:34.297034 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:34.297035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:34.297224 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:34.297419 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:34.297420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:34.297420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:34.297548 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:34.297790 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:34.297796 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:34.297925 (+ 129us) client_negotiation.cc:769] Sending connection context
0620 22:03:34.298014 (+ 89us) client_negotiation.cc:240] Negotiation successful
0620 22:03:34.298143 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":70,"threads_started":1}
I20260620 22:03:34.298763 3858 heartbeater.cc:347] Connected to a master server at 127.1.55.254:36109
I20260620 22:03:34.298871 3858 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:34.299031 3858 heartbeater.cc:511] Master 127.1.55.254:36109 requested a full tablet report, sending...
I20260620 22:03:34.299458 3667 ts_manager.cc:194] Registered new tserver with Master: 2a8a9bd7dca34ab9b1c1dfb10ec583d8 (127.1.55.193:42451)
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
I20260620 22:03:34.300032 3667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:50807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:34.313716 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36109
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:34.386178 3863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:34.386354 3863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:34.386376 3863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:34.387493 3863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:34.387533 3863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:34.387559 3863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:34.388935 3863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:34.389161 3863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:34.389369 3863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:34.393659 3868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:34.393692 3869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:34.393784 3871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:34.393962 3863 server_base.cc:1034] running on GCE node
I20260620 22:03:34.394143 3863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:34.394416 3863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:34.395586 3863 hybrid_clock.cc:648] HybridClock initialized: now 1781993014395586 us; error 37 us; skew 500 ppm
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[3622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:34.397703 3863 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:34.398115 3863 webserver.cc:460] Webserver started at http://127.1.55.194:43713/ using document root <none> and password file <none>
I20260620 22:03:34.398295 3863 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:34.398331 3863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:34.398419 3863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:34.399240 3863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "f4f0aefced24496d8294226191c16629"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "86b4c5503b95294a6a9af67face70bd1"
server_key_iv: "ec2336408036eb0fc3a4b769d4f8ff6b"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.399500 3863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "f4f0aefced24496d8294226191c16629"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "86b4c5503b95294a6a9af67face70bd1"
server_key_iv: "ec2336408036eb0fc3a4b769d4f8ff6b"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.400545 3863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:34.401098 3878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.401233 3863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:34.401307 3863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "f4f0aefced24496d8294226191c16629"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "86b4c5503b95294a6a9af67face70bd1"
server_key_iv: "ec2336408036eb0fc3a4b769d4f8ff6b"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.401355 3863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:34.417227 3863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:34.419296 3863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:34.419390 3863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:34.419530 3863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:34.419796 3863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:34.419826 3863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.419845 3863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:34.419888 3863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.425575 3863 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:33945
I20260620 22:03:34.425653 3991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:33945 every 8 connection(s)
I20260620 22:03:34.425920 3863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:03:34.427589 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 3863
I20260620 22:03:34.427693 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:34.427855 1247 external_mini_cluster.cc:1428] Setting key ac9eef7a11bf036040b0dc5586cd21fb
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[3622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:34.434715 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:34.426546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:57165 (local address 127.1.55.254:36109)
0620 22:03:34.426598 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:34.426600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:34.426791 (+ 191us) server_negotiation.cc:407] Connection header received
0620 22:03:34.427191 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:34.427192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:34.427201 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:34.427248 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:34.428209 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.428708 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.429700 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.429917 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.430011 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:34.431923 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:34.431924 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:34.431924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:34.431932 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:34.433276 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:34.433757 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:34.433758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:34.433759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:34.433813 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:34.434068 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:34.434069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:34.434069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:34.434178 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:34.434249 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:34.434535 (+ 286us) server_negotiation.cc:299] Negotiation successful
0620 22:03:34.434619 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 22:03:34.434850 3994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:34.426531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:36109 (local address 127.1.55.194:57165)
0620 22:03:34.426683 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:34.426717 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:34.427114 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:34.427299 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:34.427302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:34.427891 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:34.428112 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:34.428117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.428804 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.428805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:34.429620 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:34.429622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.430018 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.430019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:34.430149 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:34.430573 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:34.430581 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:34.431832 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:34.433375 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:34.433382 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:34.433384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:34.433654 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:34.433884 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:34.433885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:34.433885 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:34.433993 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:34.434241 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:34.434247 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:34.434397 (+ 150us) client_negotiation.cc:769] Sending connection context
0620 22:03:34.434500 (+ 103us) client_negotiation.cc:240] Negotiation successful
0620 22:03:34.434643 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
I20260620 22:03:34.435312 3992 heartbeater.cc:347] Connected to a master server at 127.1.55.254:36109
I20260620 22:03:34.435389 3992 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:34.435588 3992 heartbeater.cc:511] Master 127.1.55.254:36109 requested a full tablet report, sending...
I20260620 22:03:34.435951 3667 ts_manager.cc:194] Registered new tserver with Master: f4f0aefced24496d8294226191c16629 (127.1.55.194:33945)
I20260620 22:03:34.436296 3667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:57165
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:34.449684 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36109
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:34.522382 3997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:34.522550 3997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:34.522578 3997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:34.523599 3997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:34.523638 3997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:34.523680 3997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:34.525292 3997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:34.525542 3997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:34.525790 3997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:34.530187 4002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:34.530236 3997 server_base.cc:1034] running on GCE node
W20260620 22:03:34.530197 4003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:34.530179 4005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:34.530632 3997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:34.530866 3997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:34.532024 3997 hybrid_clock.cc:648] HybridClock initialized: now 1781993014532014 us; error 28 us; skew 500 ppm
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[3622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:34.534409 3997 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:34.534804 3997 webserver.cc:460] Webserver started at http://127.1.55.195:36173/ using document root <none> and password file <none>
I20260620 22:03:34.535007 3997 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:34.535050 3997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:34.535189 3997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:34.536113 3997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "9d3638c79fb74082af6a23b11d14de08"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "0b8aa311c5cb48ca24f996656e65b54c"
server_key_iv: "a3202f0318b978aa6fbf738641fc0548"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.536446 3997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "9d3638c79fb74082af6a23b11d14de08"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "0b8aa311c5cb48ca24f996656e65b54c"
server_key_iv: "a3202f0318b978aa6fbf738641fc0548"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.537703 3997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:03:34.538319 4012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.538468 3997 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:34.538540 3997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "9d3638c79fb74082af6a23b11d14de08"
format_stamp: "Formatted at 2026-06-20 22:03:34 on dist-test-slave-xw35"
server_key: "0b8aa311c5cb48ca24f996656e65b54c"
server_key_iv: "a3202f0318b978aa6fbf738641fc0548"
server_key_version: "encryptionkey@0"
I20260620 22:03:34.538587 3997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:34.552786 3997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:34.554455 3997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:34.554553 3997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:34.554697 3997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:34.554913 3997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:34.554941 3997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.554960 3997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:34.554972 3997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:34.560297 3997 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:43631
I20260620 22:03:34.560364 4125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:43631 every 8 connection(s)
I20260620 22:03:34.560621 3997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:03:34.563934 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 3997
I20260620 22:03:34.564033 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:34.564191 1247 external_mini_cluster.cc:1428] Setting key 21a0893befe162e00ed3bc4f444f9f66
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[3622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993014, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:34.568531 3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:34.561229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:33409 (local address 127.1.55.254:36109)
0620 22:03:34.561275 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:34.561277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:34.561451 (+ 174us) server_negotiation.cc:407] Connection header received
0620 22:03:34.561866 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:34.561868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:34.561876 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:34.561923 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:34.562669 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.563103 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.563941 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.564180 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.564254 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:34.566321 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:34.566322 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:34.566323 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:34.566328 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:34.567494 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:34.567824 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:34.567825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:34.567825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:34.567883 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:34.568080 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:34.568081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:34.568081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:34.568172 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:34.568217 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:34.568416 (+ 199us) server_negotiation.cc:299] Negotiation successful
0620 22:03:34.568473 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:03:34.568656 4128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:34.561199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:36109 (local address 127.1.55.195:33409)
0620 22:03:34.561341 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:34.561369 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:34.561790 (+ 421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:34.561965 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:34.561968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:34.562433 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:34.562597 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:34.562601 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.563170 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.563170 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:34.563853 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:34.563854 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:34.564261 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:34.564262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:34.564414 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:34.564922 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:34.564931 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:34.566250 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:34.567561 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:34.567566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:34.567567 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:34.567762 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:34.567935 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:34.567936 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:34.567936 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:34.568018 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:34.568221 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:34.568224 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:34.568315 (+ 91us) client_negotiation.cc:769] Sending connection context
0620 22:03:34.568388 (+ 73us) client_negotiation.cc:240] Negotiation successful
0620 22:03:34.568484 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":74,"threads_started":1}
I20260620 22:03:34.569089 4126 heartbeater.cc:347] Connected to a master server at 127.1.55.254:36109
I20260620 22:03:34.569178 4126 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:34.569324 4126 heartbeater.cc:511] Master 127.1.55.254:36109 requested a full tablet report, sending...
I20260620 22:03:34.569659 3667 ts_manager.cc:194] Registered new tserver with Master: 9d3638c79fb74082af6a23b11d14de08 (127.1.55.195:43631)
I20260620 22:03:34.569981 3667 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:33409
I20260620 22:03:34.575649 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260620 22:03:34.586400 3706 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:03:34.585670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52972 (local address 127.1.55.254:36109)
0620 22:03:34.585735 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:34.585737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:34.585806 (+ 69us) server_negotiation.cc:407] Connection header received
0620 22:03:34.585874 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:34.585875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:34.585883 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:34.585943 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:34.586356 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52972: BlockingRecv error: recv got EOF from 127.0.0.1:52972 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260620 22:03:34.587268 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 3729
I20260620 22:03:34.591748 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 3863
I20260620 22:03:34.595870 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 3997
I20260620 22:03:34.599908 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 3635
2026-06-20T22:03:34Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1664 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[4138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[4138](info): set up 2 sockets
Jun 20 22:03:34 dist-test-slave-xw35 krb5kdc[4138](info): commencing operation
krb5kdc: starting...
W20260620 22:03:35.569408 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.950s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:35 dist-test-slave-xw35 krb5kdc[4138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:35.672056 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42931
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:38167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:42931
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:35.744721 4151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:35.744935 4151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:35.744971 4151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:35.746083 4151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:35.746143 4151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:35.746167 4151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:35.746187 4151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:35.746212 4151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:35.747592 4151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:38167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:42931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:35.747843 4151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:35.748054 4151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:35.752198 4156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:35.752235 4157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:35.752241 4159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:35.752240 4151 server_base.cc:1034] running on GCE node
I20260620 22:03:35.752771 4151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:35.753080 4151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:35.754266 4151 hybrid_clock.cc:648] HybridClock initialized: now 1781993015754240 us; error 37 us; skew 500 ppm
Jun 20 22:03:35 dist-test-slave-xw35 krb5kdc[4138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993015, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:35.756557 4151 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:35.756980 4151 webserver.cc:460] Webserver started at http://127.1.55.254:45539/ using document root <none> and password file <none>
I20260620 22:03:35.757191 4151 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:35.757251 4151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:35.757385 4151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:35.758306 4151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "b1f945478da34aea9fb31749b46ff34a"
format_stamp: "Formatted at 2026-06-20 22:03:35 on dist-test-slave-xw35"
server_key: "f674e7888fa2d32488fa4dcf4cf6c164"
server_key_iv: "c9e0d3803d6f249d4e4f3e8b2d61fd00"
server_key_version: "encryptionkey@0"
I20260620 22:03:35.758625 4151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "b1f945478da34aea9fb31749b46ff34a"
format_stamp: "Formatted at 2026-06-20 22:03:35 on dist-test-slave-xw35"
server_key: "f674e7888fa2d32488fa4dcf4cf6c164"
server_key_iv: "c9e0d3803d6f249d4e4f3e8b2d61fd00"
server_key_version: "encryptionkey@0"
I20260620 22:03:35.759770 4151 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:35.760372 4166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:35.760515 4151 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:35.760601 4151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "b1f945478da34aea9fb31749b46ff34a"
format_stamp: "Formatted at 2026-06-20 22:03:35 on dist-test-slave-xw35"
server_key: "f674e7888fa2d32488fa4dcf4cf6c164"
server_key_iv: "c9e0d3803d6f249d4e4f3e8b2d61fd00"
server_key_version: "encryptionkey@0"
I20260620 22:03:35.760681 4151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:35.774000 4151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:35.775548 4151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:35.775718 4151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:35.779155 4151 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:42931
I20260620 22:03:35.779183 4218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:42931 every 8 connection(s)
I20260620 22:03:35.779484 4151 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:35.780215 4219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:35.782096 4219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a: Bootstrap starting.
I20260620 22:03:35.782553 4219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:35.782763 4219 log.cc:824] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:35.783288 4219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a: No bootstrap required, opened a new log
I20260620 22:03:35.784633 4219 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f945478da34aea9fb31749b46ff34a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42931 } }
I20260620 22:03:35.784749 4219 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:35.784770 4219 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f945478da34aea9fb31749b46ff34a, State: Initialized, Role: FOLLOWER
I20260620 22:03:35.784888 4219 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f945478da34aea9fb31749b46ff34a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42931 } }
I20260620 22:03:35.784961 4219 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:35.784982 4219 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:35.785009 4219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:35.785683 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 4151
I20260620 22:03:35.785791 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:35.785874 4219 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f945478da34aea9fb31749b46ff34a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42931 } }
I20260620 22:03:35.785975 4219 leader_election.cc:302] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1f945478da34aea9fb31749b46ff34a; no voters:
I20260620 22:03:35.785996 1247 external_mini_cluster.cc:1428] Setting key dc5ecda2a588f90ea2d067e566dceb4e
I20260620 22:03:35.786127 4219 leader_election.cc:288] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:35.786166 4222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:35.786345 4222 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [term 1 LEADER]: Becoming Leader. State: Replica: b1f945478da34aea9fb31749b46ff34a, State: Running, Role: LEADER
I20260620 22:03:35.786355 4219 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:35.786545 4222 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f945478da34aea9fb31749b46ff34a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42931 } }
I20260620 22:03:35.786860 4224 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1f945478da34aea9fb31749b46ff34a. Latest consensus state: current_term: 1 leader_uuid: "b1f945478da34aea9fb31749b46ff34a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f945478da34aea9fb31749b46ff34a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42931 } } }
I20260620 22:03:35.787108 4224 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:35.787045 4223 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1f945478da34aea9fb31749b46ff34a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f945478da34aea9fb31749b46ff34a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42931 } } }
I20260620 22:03:35.787360 4223 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:35.787565 4233 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:35.788115 4233 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:35.789675 4233 catalog_manager.cc:1347] Generated new cluster ID: 4c19886b91a3473982514160c9be1de8
I20260620 22:03:35.789729 4233 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:03:35 dist-test-slave-xw35 krb5kdc[4138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:35.797326 4226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:35.786386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49314 (local address 127.1.55.254:42931)
0620 22:03:35.786552 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:35.786560 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:35.786900 (+ 340us) server_negotiation.cc:407] Connection header received
0620 22:03:35.787136 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:35.787144 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:35.787199 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:35.787325 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:35.788271 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:35.789607 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:35.790581 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:35.791163 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:35.791289 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:35.793670 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:35.793674 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:35.793674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:35.793684 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:35.795849 (+ 2165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:35.796238 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:35.796240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:35.796240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:35.796325 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:35.796525 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:35.796526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:35.796526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:35.796773 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:35.796901 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:35.797028 (+ 127us) server_negotiation.cc:299] Negotiation successful
0620 22:03:35.797140 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":58,"threads_started":1}
I20260620 22:03:35.798086 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:03:35.804355 4233 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:35.804826 4233 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:35.811625 4233 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1f945478da34aea9fb31749b46ff34a: Generated new TSK 0
I20260620 22:03:35.811797 4233 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:03:35.817764 4226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:35.814380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49324 (local address 127.1.55.254:42931)
0620 22:03:35.814435 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:35.814437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:35.814540 (+ 103us) server_negotiation.cc:407] Connection header received
0620 22:03:35.814613 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:35.814614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:35.814621 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:35.814668 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:35.815076 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:35.815537 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:35.816525 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:35.816700 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:35.816743 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:35.817341 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:35.817342 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:35.817342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:35.817530 (+ 188us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:35.817548 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:35.817557 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:35.817599 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:35.817675 (+ 76us) server_negotiation.cc:299] Negotiation successful
0620 22:03:35.817691 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 22:03:35.820092 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 4151
2026-06-20T22:03:35Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1218 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:35 dist-test-slave-xw35 krb5kdc[4252](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:35 dist-test-slave-xw35 krb5kdc[4252](info): set up 2 sockets
Jun 20 22:03:35 dist-test-slave-xw35 krb5kdc[4252](info): commencing operation
krb5kdc: starting...
W20260620 22:03:36.785033 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.948s user 0.004s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:36 dist-test-slave-xw35 krb5kdc[4252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:36.887419 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40521
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:40521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:36.959944 4265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:36.960120 4265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:36.960140 4265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:36.961191 4265 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:36.961228 4265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:36.961252 4265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:36.961263 4265 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:36.961310 4265 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:36.962525 4265 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:40521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:36.962738 4265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:36.962922 4265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:36.967216 4270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:36.967226 4273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:36.967442 4265 server_base.cc:1034] running on GCE node
W20260620 22:03:36.967226 4271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:36.967743 4265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:36.968024 4265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:36.969165 4265 hybrid_clock.cc:648] HybridClock initialized: now 1781993016969146 us; error 37 us; skew 500 ppm
Jun 20 22:03:36 dist-test-slave-xw35 krb5kdc[4252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993016, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:36.971258 4265 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:36.971611 4265 webserver.cc:460] Webserver started at http://127.1.55.254:32795/ using document root <none> and password file <none>
I20260620 22:03:36.971796 4265 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:36.971835 4265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:36.971954 4265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:36.972805 4265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "6b372a945e2341b4832ae0a605903544"
format_stamp: "Formatted at 2026-06-20 22:03:36 on dist-test-slave-xw35"
server_key: "3a44517a8e09fe555d56ca6a84d1ffc4"
server_key_iv: "377cbc75581fbcdb0f211329e555ad23"
server_key_version: "encryptionkey@0"
I20260620 22:03:36.973098 4265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "6b372a945e2341b4832ae0a605903544"
format_stamp: "Formatted at 2026-06-20 22:03:36 on dist-test-slave-xw35"
server_key: "3a44517a8e09fe555d56ca6a84d1ffc4"
server_key_iv: "377cbc75581fbcdb0f211329e555ad23"
server_key_version: "encryptionkey@0"
I20260620 22:03:36.974274 4265 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:03:36.975001 4280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:36.975189 4265 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:36.975274 4265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "6b372a945e2341b4832ae0a605903544"
format_stamp: "Formatted at 2026-06-20 22:03:36 on dist-test-slave-xw35"
server_key: "3a44517a8e09fe555d56ca6a84d1ffc4"
server_key_iv: "377cbc75581fbcdb0f211329e555ad23"
server_key_version: "encryptionkey@0"
I20260620 22:03:36.975343 4265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:36.992674 4265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:36.994196 4265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:36.994316 4265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:36.997570 4265 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:40521
I20260620 22:03:36.997599 4332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:40521 every 8 connection(s)
I20260620 22:03:36.997891 4265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:36.998719 4333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:37.000599 4333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544: Bootstrap starting.
I20260620 22:03:37.000867 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 4265
I20260620 22:03:37.000936 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:37.001098 1247 external_mini_cluster.cc:1428] Setting key 106e7b50a423d47f777ce040aefbd5ee
I20260620 22:03:37.001212 4333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:37.001541 4333 log.cc:824] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:37.002193 4333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544: No bootstrap required, opened a new log
I20260620 22:03:37.004361 4333 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b372a945e2341b4832ae0a605903544" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40521 } }
I20260620 22:03:37.004531 4333 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:37.004567 4333 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b372a945e2341b4832ae0a605903544, State: Initialized, Role: FOLLOWER
I20260620 22:03:37.004709 4333 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b372a945e2341b4832ae0a605903544" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40521 } }
I20260620 22:03:37.004801 4333 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:37.004863 4333 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:37.004914 4333 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:37.005514 4333 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b372a945e2341b4832ae0a605903544" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40521 } }
I20260620 22:03:37.005612 4333 leader_election.cc:302] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b372a945e2341b4832ae0a605903544; no voters:
I20260620 22:03:37.005774 4333 leader_election.cc:288] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:37.005820 4338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:37.005951 4338 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [term 1 LEADER]: Becoming Leader. State: Replica: 6b372a945e2341b4832ae0a605903544, State: Running, Role: LEADER
I20260620 22:03:37.005983 4333 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:37.006067 4338 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b372a945e2341b4832ae0a605903544" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40521 } }
I20260620 22:03:37.006377 4338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b372a945e2341b4832ae0a605903544. Latest consensus state: current_term: 1 leader_uuid: "6b372a945e2341b4832ae0a605903544" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b372a945e2341b4832ae0a605903544" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40521 } } }
I20260620 22:03:37.006485 4338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:37.006386 4339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b372a945e2341b4832ae0a605903544" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b372a945e2341b4832ae0a605903544" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40521 } } }
I20260620 22:03:37.006682 4339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:37.006994 4345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:37.007524 4345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:37.009320 4345 catalog_manager.cc:1347] Generated new cluster ID: 6eab7075c4cc4a4aa1ef7e28f2e88d5c
I20260620 22:03:37.009367 4345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:37.016472 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:37.001555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52632 (local address 127.1.55.254:40521)
0620 22:03:37.001723 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:37.001731 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:37.001758 (+ 27us) server_negotiation.cc:407] Connection header received
0620 22:03:37.002240 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:37.002248 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:37.002308 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:37.002441 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:37.002928 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.004361 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.005323 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.005961 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.006095 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:37.008930 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:37.008933 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:37.008933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:37.008943 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:37.014967 (+ 6024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.015380 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.015383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.015384 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.015474 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.015677 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.015678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.015678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.015939 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:37.016067 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:37.016185 (+ 118us) server_negotiation.cc:299] Negotiation successful
0620 22:03:37.016293 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":70,"threads_started":1}
I20260620 22:03:37.019044 4345 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:37.019487 4345 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:37.028182 4345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b372a945e2341b4832ae0a605903544: Generated new TSK 0
I20260620 22:03:37.028330 4345 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:37.051358 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40521
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:37.124922 4359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:37.125097 4359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:37.125118 4359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:37.126263 4359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:37.126300 4359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:37.126346 4359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:37.127635 4359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:37.127847 4359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:37.128067 4359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:37.132464 4364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:37.132519 4367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:37.132532 4365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:37.132589 4359 server_base.cc:1034] running on GCE node
I20260620 22:03:37.132823 4359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:37.133044 4359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:37.134171 4359 hybrid_clock.cc:648] HybridClock initialized: now 1781993017134160 us; error 26 us; skew 500 ppm
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993017, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:37.136417 4359 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:37.136792 4359 webserver.cc:460] Webserver started at http://127.1.55.193:41431/ using document root <none> and password file <none>
I20260620 22:03:37.137002 4359 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:37.137061 4359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:37.137209 4359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:37.138134 4359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "de5c028b87504d1f81ea70c67836dba8"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "50781f2a7200a189f7d6d66eddc62b5f"
server_key_iv: "4e24a143196108731834b483c2d591e4"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.138446 4359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "de5c028b87504d1f81ea70c67836dba8"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "50781f2a7200a189f7d6d66eddc62b5f"
server_key_iv: "4e24a143196108731834b483c2d591e4"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.139565 4359 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:03:37.140210 4374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.140380 4359 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:37.140468 4359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "de5c028b87504d1f81ea70c67836dba8"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "50781f2a7200a189f7d6d66eddc62b5f"
server_key_iv: "4e24a143196108731834b483c2d591e4"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.140540 4359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:37.163815 4359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:37.165621 4359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:37.165724 4359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:37.165887 4359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:37.166102 4359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:37.166128 4359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.166147 4359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:37.166158 4359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.171525 4359 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:39867
I20260620 22:03:37.171566 4487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:39867 every 8 connection(s)
I20260620 22:03:37.171797 4359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:37.175113 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 4359
I20260620 22:03:37.175190 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:37.175369 1247 external_mini_cluster.cc:1428] Setting key 7a523500582a8ba3ddfcfc44f7ec0175
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993017, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:37.180330 4490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:37.172380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40521 (local address 127.1.55.193:56559)
0620 22:03:37.172520 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:37.172546 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:37.172922 (+ 376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:37.173094 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:37.173097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:37.173673 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:37.173829 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:37.173833 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.174415 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.174416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:37.175219 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:37.175222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.175652 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.175653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:37.175794 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:37.176238 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:37.176245 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:37.177428 (+ 1183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:37.179168 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:37.179173 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:37.179175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:37.179362 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:37.179571 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:37.179572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:37.179572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:37.179656 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:37.179918 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:37.179921 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:37.180018 (+ 97us) client_negotiation.cc:769] Sending connection context
0620 22:03:37.180092 (+ 74us) client_negotiation.cc:240] Negotiation successful
0620 22:03:37.180190 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260620 22:03:37.180367 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:37.172424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:56559 (local address 127.1.55.254:40521)
0620 22:03:37.172486 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:37.172488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:37.172614 (+ 126us) server_negotiation.cc:407] Connection header received
0620 22:03:37.172993 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:37.172994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:37.173002 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:37.173049 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:37.173898 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.174341 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.175291 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.175560 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.175645 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:37.177561 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:37.177563 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:37.177563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:37.177571 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:37.179089 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.179434 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.179436 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.179436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.179498 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.179719 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.179720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.179721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.179853 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:37.179925 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:37.180140 (+ 215us) server_negotiation.cc:299] Negotiation successful
0620 22:03:37.180241 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 22:03:37.180853 4488 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40521
I20260620 22:03:37.180945 4488 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:37.181092 4488 heartbeater.cc:511] Master 127.1.55.254:40521 requested a full tablet report, sending...
I20260620 22:03:37.181613 4297 ts_manager.cc:194] Registered new tserver with Master: de5c028b87504d1f81ea70c67836dba8 (127.1.55.193:39867)
I20260620 22:03:37.182449 4297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:56559
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:37.197782 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40521
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:37.268345 4493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:37.268517 4493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:37.268540 4493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:37.269594 4493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:37.269629 4493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:37.269651 4493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:37.270929 4493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:37.271131 4493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:37.271323 4493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:37.275620 4499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:37.275645 4501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:37.275650 4498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:37.275743 4493 server_base.cc:1034] running on GCE node
I20260620 22:03:37.275988 4493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:37.276211 4493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:37.277354 4493 hybrid_clock.cc:648] HybridClock initialized: now 1781993017277337 us; error 35 us; skew 500 ppm
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993017, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:37.279862 4493 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:37.280274 4493 webserver.cc:460] Webserver started at http://127.1.55.194:41887/ using document root <none> and password file <none>
I20260620 22:03:37.280486 4493 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:37.280531 4493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:37.280700 4493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:37.281745 4493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "a6504239cc6c4c1d9873d817219f032c"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "d87dcbfc938b3757c19d2a77d6cb96f2"
server_key_iv: "4219d64ea392ae28429c336aabf71668"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.282054 4493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "a6504239cc6c4c1d9873d817219f032c"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "d87dcbfc938b3757c19d2a77d6cb96f2"
server_key_iv: "4219d64ea392ae28429c336aabf71668"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.283239 4493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:37.283915 4508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.284080 4493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:37.284155 4493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "a6504239cc6c4c1d9873d817219f032c"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "d87dcbfc938b3757c19d2a77d6cb96f2"
server_key_iv: "4219d64ea392ae28429c336aabf71668"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.284202 4493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:37.297835 4493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:37.299320 4493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:37.299415 4493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:37.299546 4493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:37.299750 4493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:37.299777 4493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.299793 4493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:37.299804 4493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.304853 4493 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:38489
I20260620 22:03:37.304911 4621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:38489 every 8 connection(s)
I20260620 22:03:37.305155 4493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993017, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:37.311259 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 4493
I20260620 22:03:37.311380 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:37.311587 1247 external_mini_cluster.cc:1428] Setting key f257e1d6b9a11d7debb7005dfce1bcd8
I20260620 22:03:37.313766 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:37.305894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:39737 (local address 127.1.55.254:40521)
0620 22:03:37.305941 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:37.305944 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:37.306110 (+ 166us) server_negotiation.cc:407] Connection header received
0620 22:03:37.306598 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:37.306599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:37.306610 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:37.306657 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:37.307538 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.308018 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.308978 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.309173 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.309251 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:37.311046 (+ 1795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:37.311048 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:37.311053 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:37.311059 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:37.312380 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.312744 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.312745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.312745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.312820 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.313074 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.313074 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.313075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.313202 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:37.313268 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:37.313583 (+ 315us) server_negotiation.cc:299] Negotiation successful
0620 22:03:37.313660 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:03:37.313784 4624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:37.305846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40521 (local address 127.1.55.194:39737)
0620 22:03:37.306005 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:37.306037 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:37.306460 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:37.306710 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:37.306713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:37.307246 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:37.307426 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:37.307430 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.308117 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.308118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:37.308865 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:37.308867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.309261 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.309262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:37.309374 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:37.309777 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:37.309784 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:37.310968 (+ 1184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:37.312475 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:37.312481 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:37.312483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:37.312671 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:37.312885 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:37.312886 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:37.312886 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:37.312989 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:37.313275 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:37.313283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:37.313427 (+ 144us) client_negotiation.cc:769] Sending connection context
0620 22:03:37.313546 (+ 119us) client_negotiation.cc:240] Negotiation successful
0620 22:03:37.313662 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260620 22:03:37.314379 4622 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40521
I20260620 22:03:37.314459 4622 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:37.314632 4622 heartbeater.cc:511] Master 127.1.55.254:40521 requested a full tablet report, sending...
I20260620 22:03:37.314931 4297 ts_manager.cc:194] Registered new tserver with Master: a6504239cc6c4c1d9873d817219f032c (127.1.55.194:38489)
I20260620 22:03:37.315292 4297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:39737
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:37.333761 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40521
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:37.405228 4627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:37.405467 4627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:37.405512 4627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:37.406692 4627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:37.406725 4627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:37.406773 4627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:37.408219 4627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:37.408380 4627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:37.408522 4627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:37.412774 4632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:37.412779 4633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:37.412910 4627 server_base.cc:1034] running on GCE node
W20260620 22:03:37.412779 4635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:37.413235 4627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:37.413409 4627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:37.414561 4627 hybrid_clock.cc:648] HybridClock initialized: now 1781993017414563 us; error 65 us; skew 500 ppm
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993017, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:37.416834 4627 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:37.417156 4627 webserver.cc:460] Webserver started at http://127.1.55.195:43279/ using document root <none> and password file <none>
I20260620 22:03:37.417301 4627 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:37.417335 4627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:37.417407 4627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:37.418329 4627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "620a6403b5744e0d9ad2bb82bd1e05dd"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "9b0617401b9b292eb17f90eac5f7a750"
server_key_iv: "b2909db27793b0851d80e2e5895cf5a4"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.418589 4627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "620a6403b5744e0d9ad2bb82bd1e05dd"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "9b0617401b9b292eb17f90eac5f7a750"
server_key_iv: "b2909db27793b0851d80e2e5895cf5a4"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.419728 4627 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:03:37.420300 4642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.420492 4627 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:37.420573 4627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "620a6403b5744e0d9ad2bb82bd1e05dd"
format_stamp: "Formatted at 2026-06-20 22:03:37 on dist-test-slave-xw35"
server_key: "9b0617401b9b292eb17f90eac5f7a750"
server_key_iv: "b2909db27793b0851d80e2e5895cf5a4"
server_key_version: "encryptionkey@0"
I20260620 22:03:37.420635 4627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:37.439699 4627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:37.441200 4627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:37.441291 4627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:37.441443 4627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:37.441725 4627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:37.441756 4627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.441773 4627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:37.441784 4627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:37.446801 4627 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:33443
I20260620 22:03:37.446847 4755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:33443 every 8 connection(s)
I20260620 22:03:37.447093 4627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:03:37.447527 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 4627
I20260620 22:03:37.447634 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:37.447832 1247 external_mini_cluster.cc:1428] Setting key b12c3d6a31b103049b55bac0efdd8d7a
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993017, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:37.454903 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:37.447751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:48363 (local address 127.1.55.254:40521)
0620 22:03:37.447793 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:37.447795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:37.448155 (+ 360us) server_negotiation.cc:407] Connection header received
0620 22:03:37.448633 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:37.448634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:37.448645 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:37.448716 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:37.449408 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.449923 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.450739 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.450899 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.450944 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:37.452629 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:37.452630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:37.452631 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:37.452636 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:37.453898 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.454199 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.454199 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.454200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.454243 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.454425 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.454425 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.454425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.454510 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:37.454553 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:37.454791 (+ 238us) server_negotiation.cc:299] Negotiation successful
0620 22:03:37.454845 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:03:37.455060 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:37.447745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40521 (local address 127.1.55.195:48363)
0620 22:03:37.447904 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:37.447943 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:37.448511 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:37.448758 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:37.448760 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:37.449196 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:37.449336 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:37.449340 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.449989 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.449989 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:37.450674 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:37.450676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.450959 (+ 283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.450959 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:37.451042 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:37.451408 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:37.451415 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:37.452554 (+ 1139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:37.453957 (+ 1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:37.453961 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:37.453962 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:37.454140 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:37.454293 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:37.454293 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:37.454293 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:37.454376 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:37.454561 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:37.454565 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:37.454690 (+ 125us) client_negotiation.cc:769] Sending connection context
0620 22:03:37.454763 (+ 73us) client_negotiation.cc:240] Negotiation successful
0620 22:03:37.454861 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260620 22:03:37.455458 4756 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40521
I20260620 22:03:37.455550 4756 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:37.455708 4756 heartbeater.cc:511] Master 127.1.55.254:40521 requested a full tablet report, sending...
I20260620 22:03:37.456063 4297 ts_manager.cc:194] Registered new tserver with Master: 620a6403b5744e0d9ad2bb82bd1e05dd (127.1.55.195:33443)
I20260620 22:03:37.456408 4297 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:48363
I20260620 22:03:37.459424 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993017, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4252](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993017, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:37.479431 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:37.472931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52638 (local address 127.1.55.254:40521)
0620 22:03:37.473000 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:37.473002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:37.473049 (+ 47us) server_negotiation.cc:407] Connection header received
0620 22:03:37.473082 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:37.473083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:37.473091 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:37.473134 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:37.473681 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.474124 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.474841 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:37.475072 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:37.475125 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:37.476941 (+ 1816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:37.476942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:37.476943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:37.476948 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:37.478367 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.478733 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.478734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.478734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.478784 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:37.478969 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:37.478969 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:37.478970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:37.479103 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:37.479178 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:37.479272 (+ 94us) server_negotiation.cc:299] Negotiation successful
0620 22:03:37.479329 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260620 22:03:37.479667 4297 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52638
I20260620 22:03:37.480187 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 4359
I20260620 22:03:37.484594 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 4493
I20260620 22:03:37.489068 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 4627
I20260620 22:03:37.492920 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 4265
2026-06-20T22:03:37Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1674 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4768](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4768](info): set up 2 sockets
Jun 20 22:03:37 dist-test-slave-xw35 krb5kdc[4768](info): commencing operation
krb5kdc: starting...
W20260620 22:03:38.460911 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.949s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:38 dist-test-slave-xw35 krb5kdc[4768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:38.563447 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:39581
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:39581
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:38.637504 4781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:38.637693 4781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:38.637727 4781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:38.638737 4781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:38.638813 4781 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:38.638837 4781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:38.638863 4781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:38.638885 4781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:38.640235 4781 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:39581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:39581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4781
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:38.640465 4781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:38.640666 4781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:38.644676 4786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:38.644685 4789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:38.644790 4781 server_base.cc:1034] running on GCE node
W20260620 22:03:38.644686 4787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:38.645108 4781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:38.645385 4781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:38.646540 4781 hybrid_clock.cc:648] HybridClock initialized: now 1781993018646534 us; error 36 us; skew 500 ppm
Jun 20 22:03:38 dist-test-slave-xw35 krb5kdc[4768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993018, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:38.704128 4781 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:38.704533 4781 webserver.cc:460] Webserver started at http://127.1.55.254:40285/ using document root <none> and password file <none>
I20260620 22:03:38.704720 4781 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:38.704787 4781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:38.704871 4781 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:38.705889 4781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "35cec9094d2b4f9089179f71af8b5789"
format_stamp: "Formatted at 2026-06-20 22:03:38 on dist-test-slave-xw35"
server_key: "948517c7c21ac43986e382c990873d57"
server_key_iv: "588dd412cc9a076853aef34d225524b6"
server_key_version: "encryptionkey@0"
I20260620 22:03:38.706168 4781 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "35cec9094d2b4f9089179f71af8b5789"
format_stamp: "Formatted at 2026-06-20 22:03:38 on dist-test-slave-xw35"
server_key: "948517c7c21ac43986e382c990873d57"
server_key_iv: "588dd412cc9a076853aef34d225524b6"
server_key_version: "encryptionkey@0"
I20260620 22:03:38.707248 4781 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:38.707890 4796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:38.708055 4781 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:38.708140 4781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "35cec9094d2b4f9089179f71af8b5789"
format_stamp: "Formatted at 2026-06-20 22:03:38 on dist-test-slave-xw35"
server_key: "948517c7c21ac43986e382c990873d57"
server_key_iv: "588dd412cc9a076853aef34d225524b6"
server_key_version: "encryptionkey@0"
I20260620 22:03:38.708192 4781 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:38.721297 4781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:38.723246 4781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:38.723338 4781 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:38.726840 4781 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:39581
I20260620 22:03:38.726883 4848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:39581 every 8 connection(s)
I20260620 22:03:38.727325 4781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:38.727862 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 4781
I20260620 22:03:38.727978 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:38.728048 4849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:38.728183 1247 external_mini_cluster.cc:1428] Setting key beaf3dede830ee13acc9a8e3baad177d
I20260620 22:03:38.730927 4849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789: Bootstrap starting.
I20260620 22:03:38.731591 4849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:38.731870 4849 log.cc:824] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:38.732502 4849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789: No bootstrap required, opened a new log
Jun 20 22:03:38 dist-test-slave-xw35 krb5kdc[4768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:38.734865 4849 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cec9094d2b4f9089179f71af8b5789" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39581 } }
I20260620 22:03:38.735006 4849 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:38.735052 4849 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35cec9094d2b4f9089179f71af8b5789, State: Initialized, Role: FOLLOWER
I20260620 22:03:38.735239 4849 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cec9094d2b4f9089179f71af8b5789" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39581 } }
I20260620 22:03:38.735332 4849 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:38.735374 4849 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:38.735420 4849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:38.735901 4849 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cec9094d2b4f9089179f71af8b5789" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39581 } }
I20260620 22:03:38.736017 4849 leader_election.cc:302] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35cec9094d2b4f9089179f71af8b5789; no voters:
I20260620 22:03:38.736173 4849 leader_election.cc:288] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:38.736197 4854 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:38.736290 4854 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [term 1 LEADER]: Becoming Leader. State: Replica: 35cec9094d2b4f9089179f71af8b5789, State: Running, Role: LEADER
I20260620 22:03:38.736356 4854 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cec9094d2b4f9089179f71af8b5789" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39581 } }
I20260620 22:03:38.736388 4849 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:38.736637 4854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35cec9094d2b4f9089179f71af8b5789" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cec9094d2b4f9089179f71af8b5789" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39581 } } }
I20260620 22:03:38.736778 4854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:38.736953 4854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35cec9094d2b4f9089179f71af8b5789. Latest consensus state: current_term: 1 leader_uuid: "35cec9094d2b4f9089179f71af8b5789" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35cec9094d2b4f9089179f71af8b5789" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39581 } } }
I20260620 22:03:38.737021 4854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:38.737329 4861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:38.737854 4861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:38.738569 4852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:38.728631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33176 (local address 127.1.55.254:39581)
0620 22:03:38.728796 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:38.728803 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:38.728834 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:03:38.729332 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:38.729338 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:38.729380 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:38.729565 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:38.730244 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:38.731119 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:38.732152 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:38.732648 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:38.732746 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:38.735009 (+ 2263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:38.735012 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:38.735012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:38.735021 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:38.736944 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:38.737331 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:38.737334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:38.737334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:38.737451 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:38.737709 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:38.737710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:38.737710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:38.737964 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:38.738099 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:38.738312 (+ 213us) server_negotiation.cc:299] Negotiation successful
0620 22:03:38.738430 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":98,"threads_started":1}
I20260620 22:03:38.739163 4861 catalog_manager.cc:1347] Generated new cluster ID: 0665296965eb43ee96634dbf4c602e72
I20260620 22:03:38.739207 4861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:38.743245 4861 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:38.743667 4861 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:38.748364 4861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35cec9094d2b4f9089179f71af8b5789: Generated new TSK 0
I20260620 22:03:38.748519 4861 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:38.776217 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39581
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:38.873955 4875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:38.874157 4875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:38.874192 4875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:38.875308 4875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:38.875376 4875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:38.875422 4875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:38.876879 4875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:38.877125 4875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:38.877337 4875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:38.882047 4881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:38.882084 4880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:38.882200 4883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:38.882453 4875 server_base.cc:1034] running on GCE node
I20260620 22:03:38.882661 4875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:38.882913 4875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:38.884085 4875 hybrid_clock.cc:648] HybridClock initialized: now 1781993018884063 us; error 36 us; skew 500 ppm
Jun 20 22:03:38 dist-test-slave-xw35 krb5kdc[4768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993018, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:38.886624 4875 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:38.887059 4875 webserver.cc:460] Webserver started at http://127.1.55.193:40271/ using document root <none> and password file <none>
I20260620 22:03:38.887274 4875 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:38.887334 4875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:38.887524 4875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:38.888517 4875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "acabc7239251426eb095415ac61c005a"
format_stamp: "Formatted at 2026-06-20 22:03:38 on dist-test-slave-xw35"
server_key: "002ac764fc2b2b34d42d9c429782f9cf"
server_key_iv: "b193fab5b1eacb94d5a925afbc28d5ec"
server_key_version: "encryptionkey@0"
I20260620 22:03:38.888936 4875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "acabc7239251426eb095415ac61c005a"
format_stamp: "Formatted at 2026-06-20 22:03:38 on dist-test-slave-xw35"
server_key: "002ac764fc2b2b34d42d9c429782f9cf"
server_key_iv: "b193fab5b1eacb94d5a925afbc28d5ec"
server_key_version: "encryptionkey@0"
I20260620 22:03:38.890328 4875 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:38.891000 4890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:38.891194 4875 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:38.891292 4875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "acabc7239251426eb095415ac61c005a"
format_stamp: "Formatted at 2026-06-20 22:03:38 on dist-test-slave-xw35"
server_key: "002ac764fc2b2b34d42d9c429782f9cf"
server_key_iv: "b193fab5b1eacb94d5a925afbc28d5ec"
server_key_version: "encryptionkey@0"
I20260620 22:03:38.891371 4875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:38.899252 4875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:38.901607 4875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:38.901755 4875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:38.901960 4875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:38.902237 4875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:38.902290 4875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:38.902328 4875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:38.902354 4875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:38.908002 4875 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:38177
I20260620 22:03:38.908075 5003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:38177 every 8 connection(s)
I20260620 22:03:38.908360 4875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:38.910660 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 4875
I20260620 22:03:38.910796 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:38.910972 1247 external_mini_cluster.cc:1428] Setting key 2a00ed4ed601011efe07b668bda8d3e5
Jun 20 22:03:38 dist-test-slave-xw35 krb5kdc[4768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993018, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:38.918511 4852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:38.909045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:47573 (local address 127.1.55.254:39581)
0620 22:03:38.909125 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:38.909127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:38.909299 (+ 172us) server_negotiation.cc:407] Connection header received
0620 22:03:38.910324 (+ 1025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:38.910325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:38.910336 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:38.910393 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:38.911178 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:38.911985 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:38.913041 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:38.913257 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:38.913342 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:38.915742 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:38.915743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:38.915744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:38.915750 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:38.917091 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:38.917586 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:38.917587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:38.917587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:38.917639 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:38.917916 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:38.917916 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:38.917916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:38.918019 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:38.918066 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:38.918386 (+ 320us) server_negotiation.cc:299] Negotiation successful
0620 22:03:38.918453 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 22:03:38.918736 5006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:38.909026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:39581 (local address 127.1.55.193:47573)
0620 22:03:38.909179 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:38.909221 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:38.910221 (+ 1000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:38.910478 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:38.910482 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:38.910829 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:38.911075 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:38.911080 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:38.912073 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:38.912074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:38.912953 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:38.912955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:38.913352 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:38.913353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:38.913529 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:38.914026 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:38.914033 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:38.915655 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:38.917174 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:38.917180 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:38.917182 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:38.917503 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:38.917709 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:38.917710 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:38.917710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:38.917843 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:38.918084 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:38.918090 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:38.918239 (+ 149us) client_negotiation.cc:769] Sending connection context
0620 22:03:38.918358 (+ 119us) client_negotiation.cc:240] Negotiation successful
0620 22:03:38.918507 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260620 22:03:38.919201 5004 heartbeater.cc:347] Connected to a master server at 127.1.55.254:39581
I20260620 22:03:38.919294 5004 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:38.919443 5004 heartbeater.cc:511] Master 127.1.55.254:39581 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
I20260620 22:03:38.919905 4813 ts_manager.cc:194] Registered new tserver with Master: acabc7239251426eb095415ac61c005a (127.1.55.193:38177)
I20260620 22:03:38.920542 4813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:47573
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:38.934211 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39581
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:39.010015 5009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:39.010195 5009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:39.010217 5009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:39.011394 5009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:39.011430 5009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:39.011478 5009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:39.013021 5009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:39.013236 5009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:39.013427 5009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:39.018050 5015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:39.018047 5014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:39.018081 5017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:39.018321 5009 server_base.cc:1034] running on GCE node
I20260620 22:03:39.018478 5009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:39.018682 5009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:39.019814 5009 hybrid_clock.cc:648] HybridClock initialized: now 1781993019019806 us; error 27 us; skew 500 ppm
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[4768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993019, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:39.022153 5009 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:39.022579 5009 webserver.cc:460] Webserver started at http://127.1.55.194:36483/ using document root <none> and password file <none>
I20260620 22:03:39.022789 5009 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:39.022852 5009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:39.022995 5009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:39.023904 5009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "9e8cd59b1c8e469cb928f371c3bb5666"
format_stamp: "Formatted at 2026-06-20 22:03:39 on dist-test-slave-xw35"
server_key: "1bf77355b223912b44092203849c4f10"
server_key_iv: "94a540c2ef44869ae9e2a2044fe05893"
server_key_version: "encryptionkey@0"
I20260620 22:03:39.024243 5009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "9e8cd59b1c8e469cb928f371c3bb5666"
format_stamp: "Formatted at 2026-06-20 22:03:39 on dist-test-slave-xw35"
server_key: "1bf77355b223912b44092203849c4f10"
server_key_iv: "94a540c2ef44869ae9e2a2044fe05893"
server_key_version: "encryptionkey@0"
I20260620 22:03:39.025543 5009 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:03:39.026261 5024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:39.026418 5009 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:39.026506 5009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "9e8cd59b1c8e469cb928f371c3bb5666"
format_stamp: "Formatted at 2026-06-20 22:03:39 on dist-test-slave-xw35"
server_key: "1bf77355b223912b44092203849c4f10"
server_key_iv: "94a540c2ef44869ae9e2a2044fe05893"
server_key_version: "encryptionkey@0"
I20260620 22:03:39.026587 5009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:39.039021 5009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:39.040665 5009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:39.040815 5009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:39.041016 5009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:39.041294 5009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:39.041347 5009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:39.041386 5009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:39.041414 5009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:39.047005 5009 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:39873
I20260620 22:03:39.047043 5137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:39873 every 8 connection(s)
I20260620 22:03:39.047295 5009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:03:39.048467 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 5009
I20260620 22:03:39.048557 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:39.048743 1247 external_mini_cluster.cc:1428] Setting key 31dd597f9809bb016e230829aeb6653a
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[4768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993019, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
I20260620 22:03:39.057135 4852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:39.047913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:45143 (local address 127.1.55.254:39581)
0620 22:03:39.047954 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:39.047956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:39.048152 (+ 196us) server_negotiation.cc:407] Connection header received
0620 22:03:39.049121 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:39.049122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:39.049132 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:39.049195 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:39.049831 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.050514 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.051962 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.052258 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.052330 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:39.054265 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:39.054266 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:39.054266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:39.054274 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:39.055874 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:39.056256 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:39.056258 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:39.056258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:39.056319 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:39.056529 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:39.056530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:39.056530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:39.056675 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:39.056745 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:39.056950 (+ 205us) server_negotiation.cc:299] Negotiation successful
0620 22:03:39.057024 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:03:39.057225 5140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:39.047902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:39581 (local address 127.1.55.194:45143)
0620 22:03:39.048037 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:39.048073 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:39.049027 (+ 954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:39.049239 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:39.049241 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:39.049596 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:39.049752 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:39.049755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.050595 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.050595 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:39.051887 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:39.051889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.052335 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.052336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:39.052421 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:39.052901 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:39.052914 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:39.054179 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:39.055973 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:39.055978 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:39.055979 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:39.056186 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:39.056384 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:39.056384 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:39.056384 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:39.056464 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:39.056740 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:39.056743 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:39.056832 (+ 89us) client_negotiation.cc:769] Sending connection context
0620 22:03:39.056902 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 22:03:39.056995 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":79,"threads_started":1}
I20260620 22:03:39.057711 5138 heartbeater.cc:347] Connected to a master server at 127.1.55.254:39581
I20260620 22:03:39.057827 5138 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:39.057981 5138 heartbeater.cc:511] Master 127.1.55.254:39581 requested a full tablet report, sending...
I20260620 22:03:39.058319 4813 ts_manager.cc:194] Registered new tserver with Master: 9e8cd59b1c8e469cb928f371c3bb5666 (127.1.55.194:39873)
I20260620 22:03:39.058660 4813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:45143
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:39.072155 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39581
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:39.147290 5143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:39.147480 5143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:39.147504 5143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:39.148540 5143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:39.148574 5143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:39.148615 5143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:39.149943 5143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:39.150105 5143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:39.150250 5143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:39.154968 5151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:39.154990 5143 server_base.cc:1034] running on GCE node
W20260620 22:03:39.154968 5148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:39.154971 5149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:39.155355 5143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:39.155629 5143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:39.156787 5143 hybrid_clock.cc:648] HybridClock initialized: now 1781993019156784 us; error 38 us; skew 500 ppm
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[4768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993019, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:39.159198 5143 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:39.159571 5143 webserver.cc:460] Webserver started at http://127.1.55.195:46641/ using document root <none> and password file <none>
I20260620 22:03:39.159782 5143 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:39.159822 5143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:39.159953 5143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:39.160842 5143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "6e3a93438b60471e916d9d33406e4061"
format_stamp: "Formatted at 2026-06-20 22:03:39 on dist-test-slave-xw35"
server_key: "76e068341a9e0a91af5614bb3e56739e"
server_key_iv: "e66f29b44388e10a8cee6eab415699e8"
server_key_version: "encryptionkey@0"
I20260620 22:03:39.161170 5143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "6e3a93438b60471e916d9d33406e4061"
format_stamp: "Formatted at 2026-06-20 22:03:39 on dist-test-slave-xw35"
server_key: "76e068341a9e0a91af5614bb3e56739e"
server_key_iv: "e66f29b44388e10a8cee6eab415699e8"
server_key_version: "encryptionkey@0"
I20260620 22:03:39.162415 5143 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:03:39.163031 5158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:39.163208 5143 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:39.163334 5143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "6e3a93438b60471e916d9d33406e4061"
format_stamp: "Formatted at 2026-06-20 22:03:39 on dist-test-slave-xw35"
server_key: "76e068341a9e0a91af5614bb3e56739e"
server_key_iv: "e66f29b44388e10a8cee6eab415699e8"
server_key_version: "encryptionkey@0"
I20260620 22:03:39.163403 5143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:39.173405 5143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:39.175005 5143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:39.175160 5143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:39.175350 5143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:39.175609 5143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:39.175662 5143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:39.175699 5143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:39.175727 5143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:39.181042 5143 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:36705
I20260620 22:03:39.181128 5271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:36705 every 8 connection(s)
I20260620 22:03:39.181423 5143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:03:39.185809 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 5143
I20260620 22:03:39.185946 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:39.186149 1247 external_mini_cluster.cc:1428] Setting key 5cca421e30b420bb857c3e91147c59b4
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[4768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993019, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:39.189863 4852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:39.182112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:51669 (local address 127.1.55.254:39581)
0620 22:03:39.182171 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:39.182173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:39.182326 (+ 153us) server_negotiation.cc:407] Connection header received
0620 22:03:39.183164 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:39.183165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:39.183176 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:39.183222 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:39.183762 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.184242 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.185218 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.185415 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.185517 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:39.187620 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:39.187621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:39.187621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:39.187627 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:39.188759 (+ 1132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:39.189087 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:39.189088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:39.189088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:39.189142 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:39.189333 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:39.189333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:39.189333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:39.189422 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:39.189516 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:39.189748 (+ 232us) server_negotiation.cc:299] Negotiation successful
0620 22:03:39.189805 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 22:03:39.189978 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:39.182075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:39581 (local address 127.1.55.195:51669)
0620 22:03:39.182225 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:39.182253 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:39.183052 (+ 799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:39.183297 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:39.183300 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:39.183517 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:39.183674 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:39.183677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.184331 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.184332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:39.185128 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:39.185130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.185513 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.185513 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:39.185665 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:39.186255 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:39.186265 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:39.187539 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:39.188824 (+ 1285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:39.188829 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:39.188830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:39.189017 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:39.189195 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:39.189196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:39.189196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:39.189280 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:39.189505 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:39.189511 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:39.189624 (+ 113us) client_negotiation.cc:769] Sending connection context
0620 22:03:39.189704 (+ 80us) client_negotiation.cc:240] Negotiation successful
0620 22:03:39.189804 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260620 22:03:39.190439 5272 heartbeater.cc:347] Connected to a master server at 127.1.55.254:39581
I20260620 22:03:39.190536 5272 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:39.190691 5272 heartbeater.cc:511] Master 127.1.55.254:39581 requested a full tablet report, sending...
I20260620 22:03:39.191013 4813 ts_manager.cc:194] Registered new tserver with Master: 6e3a93438b60471e916d9d33406e4061 (127.1.55.195:36705)
I20260620 22:03:39.191365 4813 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:51669
I20260620 22:03:39.197544 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[4768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[4768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:39.218333 5279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:39.211121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48620 (local address 127.1.55.193:38177)
0620 22:03:39.211279 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:39.211282 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:39.211291 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:39.211312 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:39.211314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:39.211326 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:39.211410 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:39.212057 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.212750 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.213440 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.213789 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.213843 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:39.215984 (+ 2141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:39.215990 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:39.215991 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:39.215996 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:39.217328 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:39.217695 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:39.217697 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:39.217698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:39.217761 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:39.217904 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:39.217904 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:39.217905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:39.218006 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:39.218093 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:39.218160 (+ 67us) server_negotiation.cc:299] Negotiation successful
0620 22:03:39.218217 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[4768](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:39.225306 4852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:39.219503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33192 (local address 127.1.55.254:39581)
0620 22:03:39.219540 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:39.219542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:39.219574 (+ 32us) server_negotiation.cc:407] Connection header received
0620 22:03:39.219631 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:39.219631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:39.219639 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:39.219681 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:39.220065 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.220505 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.221088 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:39.221246 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:39.221300 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:39.223174 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:39.223176 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:39.223176 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:39.223183 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:39.224201 (+ 1018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:39.224523 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:39.224524 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:39.224525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:39.224581 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:39.224779 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:39.224780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:39.224780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:39.224916 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:39.225015 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:39.225145 (+ 130us) server_negotiation.cc:299] Negotiation successful
0620 22:03:39.225211 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260620 22:03:39.225543 4813 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33192
I20260620 22:03:39.225871 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 4875
I20260620 22:03:39.230577 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 5009
I20260620 22:03:39.234724 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 5143
I20260620 22:03:39.239547 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 4781
2026-06-20T22:03:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1746 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[5284](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[5284](info): set up 2 sockets
Jun 20 22:03:39 dist-test-slave-xw35 krb5kdc[5284](info): commencing operation
krb5kdc: starting...
W20260620 22:03:40.225239 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.967s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:40.327766 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46441
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:44187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:46441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:40.400888 5297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:40.401083 5297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:40.401116 5297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:40.402124 5297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:40.402189 5297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:40.402210 5297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:40.402245 5297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:40.402273 5297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:40.403573 5297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:44187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:46441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:40.403820 5297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:40.404016 5297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:40.408318 5303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:40.408332 5305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:40.408332 5302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:40.408414 5297 server_base.cc:1034] running on GCE node
I20260620 22:03:40.408738 5297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:40.408985 5297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:40.410135 5297 hybrid_clock.cc:648] HybridClock initialized: now 1781993020410120 us; error 28 us; skew 500 ppm
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:40.412421 5297 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:40.412753 5297 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:40.412797 5297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:40.412958 5297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:40.413882 5297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "3f40e0b08a6143d9893ee5170b4ba323"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "f8d34068a66e33765feb255dfb4889d2"
server_key_iv: "d19efd87f72aa81a61eb97aea3af1ca6"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.414222 5297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "3f40e0b08a6143d9893ee5170b4ba323"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "f8d34068a66e33765feb255dfb4889d2"
server_key_iv: "d19efd87f72aa81a61eb97aea3af1ca6"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.415395 5297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:40.416057 5311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.416219 5297 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:40.416321 5297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "3f40e0b08a6143d9893ee5170b4ba323"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "f8d34068a66e33765feb255dfb4889d2"
server_key_iv: "d19efd87f72aa81a61eb97aea3af1ca6"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.416363 5297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:40.443347 5297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:40.445515 5297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:40.445618 5297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:40.449012 5297 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:46441
I20260620 22:03:40.449110 5363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:46441 every 8 connection(s)
I20260620 22:03:40.449348 5297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:40.450240 5364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:40.451565 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 5297
I20260620 22:03:40.451673 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:40.451841 1247 external_mini_cluster.cc:1428] Setting key d2f96a428c44195c75c10f77d162a3f8
I20260620 22:03:40.452714 5364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323: Bootstrap starting.
I20260620 22:03:40.453413 5364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:40.453708 5364 log.cc:824] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:40.454442 5364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323: No bootstrap required, opened a new log
I20260620 22:03:40.456607 5364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f40e0b08a6143d9893ee5170b4ba323" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46441 } }
I20260620 22:03:40.457607 5364 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:40.457666 5364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f40e0b08a6143d9893ee5170b4ba323, State: Initialized, Role: FOLLOWER
I20260620 22:03:40.457803 5364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f40e0b08a6143d9893ee5170b4ba323" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46441 } }
I20260620 22:03:40.457895 5364 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:40.457933 5364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:40.457980 5364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 0 FOLLOWER]: Advancing to term 1
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:40.462172 5367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.452346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51396 (local address 127.1.55.254:46441)
0620 22:03:40.452532 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:40.452541 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:40.452572 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:03:40.453109 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:40.453118 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:40.453175 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:40.453327 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:40.454011 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.455300 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.456040 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.456694 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.456796 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.459086 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:40.459090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:40.459091 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:40.459100 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:40.460906 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.461198 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.461200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.461201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.461274 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.461411 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.461412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.461412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.461658 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:40.461750 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:40.461890 (+ 140us) server_negotiation.cc:299] Negotiation successful
0620 22:03:40.462031 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260620 22:03:40.468708 5364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f40e0b08a6143d9893ee5170b4ba323" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46441 } }
I20260620 22:03:40.468819 5364 leader_election.cc:302] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f40e0b08a6143d9893ee5170b4ba323; no voters:
I20260620 22:03:40.468964 5364 leader_election.cc:288] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:40.468994 5369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:40.469156 5369 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [term 1 LEADER]: Becoming Leader. State: Replica: 3f40e0b08a6143d9893ee5170b4ba323, State: Running, Role: LEADER
I20260620 22:03:40.469190 5364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:40.469261 5369 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f40e0b08a6143d9893ee5170b4ba323" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46441 } }
I20260620 22:03:40.469622 5370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f40e0b08a6143d9893ee5170b4ba323" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f40e0b08a6143d9893ee5170b4ba323" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46441 } } }
I20260620 22:03:40.469717 5370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:40.469861 5371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f40e0b08a6143d9893ee5170b4ba323. Latest consensus state: current_term: 1 leader_uuid: "3f40e0b08a6143d9893ee5170b4ba323" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f40e0b08a6143d9893ee5170b4ba323" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46441 } } }
I20260620 22:03:40.469964 5371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:40.470373 5374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:40.470853 5374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:40.472167 5374 catalog_manager.cc:1347] Generated new cluster ID: b0f1d5e6eb6649239177ba3772ae9440
I20260620 22:03:40.472221 5374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:40.504824 5374 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:40.505542 5374 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:40.514142 5374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323: Generated new TSK 0
I20260620 22:03:40.514376 5374 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:40.541847 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46441
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:44187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:40.617105 5390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:40.617274 5390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:40.617296 5390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:40.618335 5390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:40.618364 5390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:40.618388 5390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:40.619765 5390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:44187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:40.619926 5390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:40.620069 5390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:40.624634 5398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:40.624640 5395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:40.624619 5396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:40.625026 5390 server_base.cc:1034] running on GCE node
I20260620 22:03:40.625293 5390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:40.625562 5390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:40.626718 5390 hybrid_clock.cc:648] HybridClock initialized: now 1781993020626706 us; error 24 us; skew 500 ppm
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:40.629074 5390 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:40.629403 5390 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:40.629470 5390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:40.629629 5390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:40.630538 5390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "28f8f440cfe247818cb8b90869517964"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "25d88b800612a91c7c0216418282641d"
server_key_iv: "8530ad02a967d3c1acab3b640ccba114"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.630867 5390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "28f8f440cfe247818cb8b90869517964"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "25d88b800612a91c7c0216418282641d"
server_key_iv: "8530ad02a967d3c1acab3b640ccba114"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.632112 5390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:40.632858 5404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.633028 5390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:40.633124 5390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "28f8f440cfe247818cb8b90869517964"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "25d88b800612a91c7c0216418282641d"
server_key_iv: "8530ad02a967d3c1acab3b640ccba114"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.633208 5390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:40.655073 5390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:40.657265 5390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:40.657445 5390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:40.657685 5390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:40.657964 5390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:40.658016 5390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.658052 5390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:40.658079 5390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.663148 5390 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:46091
I20260620 22:03:40.663182 5517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:46091 every 8 connection(s)
I20260620 22:03:40.663393 5390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:40.665660 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 5390
I20260620 22:03:40.665769 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:40.665946 1247 external_mini_cluster.cc:1428] Setting key 0ff2a1aa2c38833656283c6ba8a84e37
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:40.672724 5367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.663987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:52073 (local address 127.1.55.254:46441)
0620 22:03:40.664035 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:40.664038 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:40.664208 (+ 170us) server_negotiation.cc:407] Connection header received
0620 22:03:40.664625 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:40.664626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:40.664638 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:40.664684 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:40.665573 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.666230 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.667419 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.667635 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.667692 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.670058 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:40.670060 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:40.670060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:40.670068 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:40.671464 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.671840 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.671841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.671841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.671899 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.672139 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.672140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.672140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.672255 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:40.672325 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:40.672567 (+ 242us) server_negotiation.cc:299] Negotiation successful
0620 22:03:40.672640 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:03:40.672883 5520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.663966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46441 (local address 127.1.55.193:52073)
0620 22:03:40.664100 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:40.664128 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:40.664524 (+ 396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:40.664756 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:40.664759 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:40.664992 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:40.665424 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.665428 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.666296 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.666297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.667329 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.667332 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.667715 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.667716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.667865 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.668366 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:40.668373 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:40.669978 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:40.671560 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:40.671566 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:40.671568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:40.671768 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:40.671965 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:40.671966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:40.671966 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:40.672065 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:40.672319 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:40.672325 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:40.672446 (+ 121us) client_negotiation.cc:769] Sending connection context
0620 22:03:40.672546 (+ 100us) client_negotiation.cc:240] Negotiation successful
0620 22:03:40.672686 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260620 22:03:40.673372 5518 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46441
I20260620 22:03:40.673461 5518 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:40.673631 5518 heartbeater.cc:511] Master 127.1.55.254:46441 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
I20260620 22:03:40.674100 5328 ts_manager.cc:194] Registered new tserver with Master: 28f8f440cfe247818cb8b90869517964 (127.1.55.193:46091)
I20260620 22:03:40.674674 5328 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:52073
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:40.688208 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46441
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:44187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:40.761307 5523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:40.761552 5523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:40.761577 5523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:40.762622 5523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:40.762655 5523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:40.762678 5523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:40.764034 5523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:44187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:40.764190 5523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:40.764338 5523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:40.768862 5528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:40.768823 5531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:40.768831 5529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:40.769021 5523 server_base.cc:1034] running on GCE node
I20260620 22:03:40.769217 5523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:40.769446 5523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:40.770623 5523 hybrid_clock.cc:648] HybridClock initialized: now 1781993020770618 us; error 31 us; skew 500 ppm
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:40.772790 5523 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:40.773067 5523 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:40.773139 5523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:40.773270 5523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:40.774181 5523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "74e575d144d37aca23104250ae6a3987"
server_key_iv: "f6fb23851fe5cf115c6b17490e858ec9"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.774494 5523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "74e575d144d37aca23104250ae6a3987"
server_key_iv: "f6fb23851fe5cf115c6b17490e858ec9"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.775688 5523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:03:40.776379 5537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.776528 5523 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:40.776614 5523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "74e575d144d37aca23104250ae6a3987"
server_key_iv: "f6fb23851fe5cf115c6b17490e858ec9"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.776688 5523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:40.796826 5523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:40.798842 5523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:40.798988 5523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:40.799186 5523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:40.799449 5523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:40.799499 5523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.799535 5523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:40.799557 5523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.804710 5523 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:36719
I20260620 22:03:40.804772 5650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:36719 every 8 connection(s)
I20260620 22:03:40.805052 5523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:40.812155 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 5523
I20260620 22:03:40.812263 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:40.812443 1247 external_mini_cluster.cc:1428] Setting key 5ecf5ffb6ef950e0093a687a844013ad
I20260620 22:03:40.813640 5367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.805749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:54573 (local address 127.1.55.254:46441)
0620 22:03:40.805832 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:40.805835 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:40.805995 (+ 160us) server_negotiation.cc:407] Connection header received
0620 22:03:40.806445 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:40.806446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:40.806457 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:40.806505 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:40.807275 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.807786 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.808769 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.808964 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.809048 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.810924 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:40.810925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:40.810926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:40.810931 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:40.812324 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.812746 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.812747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.812747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.812801 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.813041 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.813042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.813042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.813147 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:40.813213 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:40.813487 (+ 274us) server_negotiation.cc:299] Negotiation successful
0620 22:03:40.813558 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 22:03:40.813795 5653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.805706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46441 (local address 127.1.55.194:54573)
0620 22:03:40.805873 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:40.805919 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:40.806354 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:40.806560 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:40.806563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:40.806784 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:40.807182 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.807186 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.807875 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.807876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.808659 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.808661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.809064 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.809065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.809176 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.809650 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:40.809657 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:40.810851 (+ 1194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:40.812404 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:40.812408 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:40.812409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:40.812642 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:40.812871 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:40.812872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:40.812872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:40.812968 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:40.813216 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:40.813222 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:40.813338 (+ 116us) client_negotiation.cc:769] Sending connection context
0620 22:03:40.813452 (+ 114us) client_negotiation.cc:240] Negotiation successful
0620 22:03:40.813601 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260620 22:03:40.814224 5651 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46441
I20260620 22:03:40.814301 5651 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:40.814428 5651 heartbeater.cc:511] Master 127.1.55.254:46441 requested a full tablet report, sending...
I20260620 22:03:40.814764 5328 ts_manager.cc:194] Registered new tserver with Master: 6dd60dc5a83e49f39e3c27c5285dc4ba (127.1.55.194:36719)
I20260620 22:03:40.815285 5328 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:54573
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:40.833794 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46441
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:44187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:40.906402 5656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:40.906597 5656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:40.906633 5656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:40.907706 5656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:40.907766 5656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:40.907809 5656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:40.909271 5656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:44187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:40.909539 5656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:40.909727 5656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:40.913897 5662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:40.913904 5661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:40.913962 5656 server_base.cc:1034] running on GCE node
W20260620 22:03:40.914113 5664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:40.914338 5656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:40.914556 5656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:40.915695 5656 hybrid_clock.cc:648] HybridClock initialized: now 1781993020915684 us; error 25 us; skew 500 ppm
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:40.917838 5656 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:40.918128 5656 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:40.918167 5656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:40.918288 5656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:40.919154 5656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "e326aa4887e14c51bd145d5ad5f5d78d"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "1da1b7cc08405ae4ba9f5345e3c42516"
server_key_iv: "70d9889b62872384b9bda68ed224318a"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.919454 5656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "e326aa4887e14c51bd145d5ad5f5d78d"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "1da1b7cc08405ae4ba9f5345e3c42516"
server_key_iv: "70d9889b62872384b9bda68ed224318a"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.920534 5656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:03:40.921118 5670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.921262 5656 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.921341 5656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "e326aa4887e14c51bd145d5ad5f5d78d"
format_stamp: "Formatted at 2026-06-20 22:03:40 on dist-test-slave-xw35"
server_key: "1da1b7cc08405ae4ba9f5345e3c42516"
server_key_iv: "70d9889b62872384b9bda68ed224318a"
server_key_version: "encryptionkey@0"
I20260620 22:03:40.921409 5656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:40.939131 5656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:40.940577 5656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:40.940667 5656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:40.940802 5656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:40.941057 5656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:40.941089 5656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.941107 5656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:40.941156 5656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:40.946273 5656 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:40519
I20260620 22:03:40.946307 5783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:40519 every 8 connection(s)
I20260620 22:03:40.946512 5656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:03:40.947649 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 5656
I20260620 22:03:40.947764 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:40.947952 1247 external_mini_cluster.cc:1428] Setting key 378b9de6226a70ce90b5796fc9ee0f3c
Jun 20 22:03:40 dist-test-slave-xw35 krb5kdc[5284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993020, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:40.954453 5367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.947087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:48095 (local address 127.1.55.254:46441)
0620 22:03:40.947134 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:40.947136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:40.947300 (+ 164us) server_negotiation.cc:407] Connection header received
0620 22:03:40.947727 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:40.947728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:40.947743 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:40.947821 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:40.948910 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.949341 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.950207 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.950389 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.950436 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.952116 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:40.952117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:40.952118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:40.952123 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:40.953416 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.953767 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.953768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.953768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.953814 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.953997 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.953997 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.953997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.954093 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:40.954140 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:40.954336 (+ 196us) server_negotiation.cc:299] Negotiation successful
0620 22:03:40.954397 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260620 22:03:40.954630 5786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.947070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46441 (local address 127.1.55.195:48095)
0620 22:03:40.947218 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:40.947244 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:40.947639 (+ 395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:40.947896 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:40.947900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:40.948248 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:40.948826 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.948831 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.949403 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.949404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.950142 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.950144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.950454 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.950454 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.950534 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.950884 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:40.950891 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:40.952036 (+ 1145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:40.953521 (+ 1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:40.953526 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:40.953528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:40.953711 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:40.953869 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:40.953869 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:40.953869 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:40.953949 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:40.954144 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:40.954147 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:40.954251 (+ 104us) client_negotiation.cc:769] Sending connection context
0620 22:03:40.954322 (+ 71us) client_negotiation.cc:240] Negotiation successful
0620 22:03:40.954425 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
I20260620 22:03:40.955093 5784 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46441
I20260620 22:03:40.955176 5784 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:40.955268 5784 heartbeater.cc:511] Master 127.1.55.254:46441 requested a full tablet report, sending...
I20260620 22:03:40.955578 5328 ts_manager.cc:194] Registered new tserver with Master: e326aa4887e14c51bd145d5ad5f5d78d (127.1.55.195:40519)
I20260620 22:03:40.955919 5328 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:48095
I20260620 22:03:40.959458 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:03:40.965364 5367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.960526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51400 (local address 127.1.55.254:46441)
0620 22:03:40.960553 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:40.960555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:40.960657 (+ 102us) server_negotiation.cc:407] Connection header received
0620 22:03:40.960709 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:40.960709 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:40.960716 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:40.960749 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:40.961226 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.961652 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.962364 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.962502 (+ 138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.962540 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.963410 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:40.963411 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:40.963411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:40.963416 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:40.964566 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.964820 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.964821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.964821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.964862 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:40.965015 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:40.965016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:40.965016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:40.965121 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:40.965184 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:40.965266 (+ 82us) server_negotiation.cc:299] Negotiation successful
0620 22:03:40.965315 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:03:40.966760 5328 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:40.968263 5328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:40.973753 5796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.970374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53954 (local address 127.1.55.195:40519)
0620 22:03:40.970489 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:40.970493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:40.970692 (+ 199us) server_negotiation.cc:407] Connection header received
0620 22:03:40.970775 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:40.970777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:40.970789 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:40.970846 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:40.971208 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.971901 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.972818 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.973355 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.973439 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.973504 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:40.973659 (+ 155us) server_negotiation.cc:299] Negotiation successful
0620 22:03:40.973687 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":67,"threads_started":1}
I20260620 22:03:40.973745 5795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.970296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40519 (local address 127.0.0.1:53954)
0620 22:03:40.970628 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:40.970636 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:40.970681 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:40.970860 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:40.970861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:40.970864 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:40.970929 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.970930 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.972016 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.972017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.972730 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.972732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.973445 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.973445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.973536 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.973548 (+ 12us) client_negotiation.cc:769] Sending connection context
0620 22:03:40.973646 (+ 98us) client_negotiation.cc:240] Negotiation successful
0620 22:03:40.973689 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":2,"thread_start_us":50,"threads_started":1}
I20260620 22:03:40.974061 5793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.970106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:36719 (local address 127.0.0.1:36092)
0620 22:03:40.970253 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:40.970279 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:40.970349 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:40.970742 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:40.970745 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:40.970746 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:40.970802 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.970803 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.971858 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.971859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.972948 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.972950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.973897 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.973898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.973947 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.973951 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:40.973975 (+ 24us) client_negotiation.cc:240] Negotiation successful
0620 22:03:40.974006 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":62,"threads_started":1}
I20260620 22:03:40.974355 5718 tablet_service.cc:1467] Processing CreateTablet for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7 (DEFAULT_TABLE table=test-table [id=0396a95a363f4b3ba4559a7e84b49182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:40.974431 5797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.970418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36092 (local address 127.1.55.194:36719)
0620 22:03:40.970568 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:40.970571 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:40.970587 (+ 16us) server_negotiation.cc:407] Connection header received
0620 22:03:40.970619 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:40.970621 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:40.970637 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:40.970721 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:40.970882 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.971761 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.973033 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.973712 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.974253 (+ 541us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.974307 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:40.974327 (+ 20us) server_negotiation.cc:299] Negotiation successful
0620 22:03:40.974361 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260620 22:03:40.974620 5718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:40.974888 5585 tablet_service.cc:1467] Processing CreateTablet for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7 (DEFAULT_TABLE table=test-table [id=0396a95a363f4b3ba4559a7e84b49182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:40.975176 5585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:40.976920 5798 tablet_bootstrap.cc:492] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Bootstrap starting.
I20260620 22:03:40.977438 5799 tablet_bootstrap.cc:492] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Bootstrap starting.
I20260620 22:03:40.977483 5798 tablet_bootstrap.cc:654] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:40.977979 5792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.970133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:46091 (local address 127.0.0.1:52528)
0620 22:03:40.970467 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:40.970478 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:40.970526 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:40.971006 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:40.971007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:40.971009 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:40.972045 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.972048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.973181 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.973182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.974151 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:40.974154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.977768 (+ 3614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.977769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:40.977829 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.977832 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:40.977885 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 22:03:40.977919 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":40,"threads_started":1}
I20260620 22:03:40.978005 5794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:40.970239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.1.55.193:46091)
0620 22:03:40.970828 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:40.970832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:40.970841 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:40.970877 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:40.970879 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:40.970892 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:40.970986 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:40.972137 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.973093 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.974229 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:40.977678 (+ 3449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:40.977755 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:40.977804 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:40.977897 (+ 93us) server_negotiation.cc:299] Negotiation successful
0620 22:03:40.977932 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":71,"threads_started":1}
I20260620 22:03:40.978127 5799 tablet_bootstrap.cc:654] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:40.978420 5798 log.cc:824] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:40.978699 5799 log.cc:824] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:40.978842 5452 tablet_service.cc:1467] Processing CreateTablet for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7 (DEFAULT_TABLE table=test-table [id=0396a95a363f4b3ba4559a7e84b49182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:40.979121 5798 tablet_bootstrap.cc:492] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: No bootstrap required, opened a new log
I20260620 22:03:40.979137 5452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:40.979174 5798 ts_tablet_manager.cc:1397] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:03:40.979250 5799 tablet_bootstrap.cc:492] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: No bootstrap required, opened a new log
I20260620 22:03:40.979287 5799 ts_tablet_manager.cc:1397] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:03:40.980542 5799 raft_consensus.cc:348] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:40.980644 5799 raft_consensus.cc:374] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:40.980664 5799 raft_consensus.cc:729] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd60dc5a83e49f39e3c27c5285dc4ba, State: Initialized, Role: FOLLOWER
I20260620 22:03:40.980760 5799 consensus_queue.cc:260] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:40.980993 5651 heartbeater.cc:503] Master 127.1.55.254:46441 was elected leader, sending a full tablet report...
I20260620 22:03:40.980998 5799 ts_tablet_manager.cc:1428] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:03:40.980898 5798 raft_consensus.cc:348] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:40.981283 5798 raft_consensus.cc:374] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:40.981318 5798 raft_consensus.cc:729] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e326aa4887e14c51bd145d5ad5f5d78d, State: Initialized, Role: FOLLOWER
I20260620 22:03:40.981407 5798 consensus_queue.cc:260] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:40.981668 5798 ts_tablet_manager.cc:1428] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260620 22:03:40.981817 5784 heartbeater.cc:503] Master 127.1.55.254:46441 was elected leader, sending a full tablet report...
I20260620 22:03:40.982091 5804 tablet_bootstrap.cc:492] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964: Bootstrap starting.
I20260620 22:03:40.982589 5804 tablet_bootstrap.cc:654] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:40.983014 5804 log.cc:824] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:40.983642 5804 tablet_bootstrap.cc:492] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964: No bootstrap required, opened a new log
I20260620 22:03:40.983704 5804 ts_tablet_manager.cc:1397] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:40.984881 5804 raft_consensus.cc:348] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:40.985008 5804 raft_consensus.cc:374] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:40.985029 5804 raft_consensus.cc:729] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28f8f440cfe247818cb8b90869517964, State: Initialized, Role: FOLLOWER
I20260620 22:03:40.985168 5804 consensus_queue.cc:260] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:40.985395 5804 ts_tablet_manager.cc:1428] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:03:40.985437 5518 heartbeater.cc:503] Master 127.1.55.254:46441 was elected leader, sending a full tablet report...
W20260620 22:03:41.055558 5652 tablet.cc:2369] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:03:41.164053 5519 tablet.cc:2369] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:03:41.196960 5785 tablet.cc:2369] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:03:41.236032 5806 raft_consensus.cc:482] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:41.236130 5806 raft_consensus.cc:504] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:41.236505 5806 leader_election.cc:288] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dd60dc5a83e49f39e3c27c5285dc4ba (127.1.55.194:36719), e326aa4887e14c51bd145d5ad5f5d78d (127.1.55.195:40519)
I20260620 22:03:41.239625 5797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.236783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:53933 (local address 127.1.55.194:36719)
0620 22:03:41.236848 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.236851 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.237005 (+ 154us) server_negotiation.cc:407] Connection header received
0620 22:03:41.237034 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.237035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.237053 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.237119 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:41.237271 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.237876 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.238900 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.239275 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.239360 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:41.239368 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.239509 (+ 141us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.239547 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260620 22:03:41.239634 5796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.236973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:42313 (local address 127.1.55.195:40519)
0620 22:03:41.237036 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.237038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.237047 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:41.237114 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.237116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.237125 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.237194 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:41.237356 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.237892 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.238898 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.239277 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.239357 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:41.239366 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.239522 (+ 156us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.239555 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 22:03:41.239662 5807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.236682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:36719 (local address 127.1.55.193:53933)
0620 22:03:41.236843 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.236856 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.236945 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.237124 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.237125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.237127 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:41.237197 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:41.237201 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.237961 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.237962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:41.238796 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:41.238798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.239361 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.239362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:41.239431 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:41.239440 (+ 9us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.239505 (+ 65us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.239552 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":29,"thread_start_us":86,"threads_started":1}
I20260620 22:03:41.239681 5808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.236884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40519 (local address 127.1.55.193:42313)
0620 22:03:41.236967 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.236984 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.237057 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.237198 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.237199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.237200 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:41.237285 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:41.237287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.237972 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.237974 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:41.238798 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:41.238800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.239367 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.239369 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:41.239448 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:41.239451 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.239517 (+ 66us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.239555 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":1,"thread_start_us":39,"threads_started":1}
I20260620 22:03:41.240185 5738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec6be14c4d3b4d819b95bb8a02d2c7c7" candidate_uuid: "28f8f440cfe247818cb8b90869517964" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" is_pre_election: true
I20260620 22:03:41.240227 5605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec6be14c4d3b4d819b95bb8a02d2c7c7" candidate_uuid: "28f8f440cfe247818cb8b90869517964" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" is_pre_election: true
I20260620 22:03:41.240329 5605 raft_consensus.cc:2454] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28f8f440cfe247818cb8b90869517964 in term 0.
I20260620 22:03:41.240334 5738 raft_consensus.cc:2454] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28f8f440cfe247818cb8b90869517964 in term 0.
I20260620 22:03:41.240532 5407 leader_election.cc:302] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28f8f440cfe247818cb8b90869517964, e326aa4887e14c51bd145d5ad5f5d78d; no voters:
I20260620 22:03:41.240665 5806 raft_consensus.cc:2781] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:41.240747 5806 raft_consensus.cc:482] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:41.240780 5806 raft_consensus.cc:3037] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:41.241462 5806 raft_consensus.cc:504] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:41.241659 5806 leader_election.cc:288] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [CANDIDATE]: Term 1 election: Requested vote from peers 6dd60dc5a83e49f39e3c27c5285dc4ba (127.1.55.194:36719), e326aa4887e14c51bd145d5ad5f5d78d (127.1.55.195:40519)
I20260620 22:03:41.241797 5605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec6be14c4d3b4d819b95bb8a02d2c7c7" candidate_uuid: "28f8f440cfe247818cb8b90869517964" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba"
I20260620 22:03:41.241843 5738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec6be14c4d3b4d819b95bb8a02d2c7c7" candidate_uuid: "28f8f440cfe247818cb8b90869517964" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e326aa4887e14c51bd145d5ad5f5d78d"
I20260620 22:03:41.241885 5605 raft_consensus.cc:3037] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:41.241940 5738 raft_consensus.cc:3037] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:41.242549 5605 raft_consensus.cc:2454] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28f8f440cfe247818cb8b90869517964 in term 1.
I20260620 22:03:41.242707 5738 raft_consensus.cc:2454] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28f8f440cfe247818cb8b90869517964 in term 1.
I20260620 22:03:41.242746 5407 leader_election.cc:302] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28f8f440cfe247818cb8b90869517964, 6dd60dc5a83e49f39e3c27c5285dc4ba; no voters:
I20260620 22:03:41.242869 5806 raft_consensus.cc:2781] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:41.243021 5806 raft_consensus.cc:686] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [term 1 LEADER]: Becoming Leader. State: Replica: 28f8f440cfe247818cb8b90869517964, State: Running, Role: LEADER
I20260620 22:03:41.243117 5806 consensus_queue.cc:237] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } }
I20260620 22:03:41.243840 5328 catalog_manager.cc:5495] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 reported cstate change: term changed from 0 to 1, leader changed from <none> to 28f8f440cfe247818cb8b90869517964 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "28f8f440cfe247818cb8b90869517964" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28f8f440cfe247818cb8b90869517964" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46091 } health_report { overall_health: HEALTHY } } }
I20260620 22:03:41.254505 5794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.252054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52542 (local address 127.1.55.193:46091)
0620 22:03:41.252116 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.252118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.252126 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:03:41.252189 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.252190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.252203 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.252251 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:41.252360 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.252843 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.253799 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:41.253980 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:41.254052 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:41.254223 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:41.254303 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:41.254386 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.254421 (+ 35us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.254437 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260620 22:03:41.255944 5738 raft_consensus.cc:1261] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 1 FOLLOWER]: Refusing update from remote peer 28f8f440cfe247818cb8b90869517964: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:41.255944 5605 raft_consensus.cc:1261] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 1 FOLLOWER]: Refusing update from remote peer 28f8f440cfe247818cb8b90869517964: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:41.256265 5806 consensus_queue.cc:1035] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e326aa4887e14c51bd145d5ad5f5d78d" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:41.256361 5809 consensus_queue.cc:1035] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 28f8f440cfe247818cb8b90869517964 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dd60dc5a83e49f39e3c27c5285dc4ba" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:41.259172 5813 mvcc.cc:205] Tried to move back new op lower bound from 7299043415062233088 to 7299043415012331520. Current Snapshot: MvccSnapshot[applied={T|T < 7299043415062233088}]
I20260620 22:03:41.260542 5328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:41.260614 5328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:41.261183 5328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f40e0b08a6143d9893ee5170b4ba323: Sending DeleteTablet for 3 replicas of tablet ec6be14c4d3b4d819b95bb8a02d2c7c7
I20260620 22:03:41.261451 5585 tablet_service.cc:1514] Processing DeleteTablet for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:41 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36092
I20260620 22:03:41.261457 5718 tablet_service.cc:1514] Processing DeleteTablet for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:41 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:53954
I20260620 22:03:41.261667 5823 tablet_replica.cc:330] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: stopping tablet replica
I20260620 22:03:41.261750 5823 raft_consensus.cc:2229] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:41.261761 5822 tablet_replica.cc:330] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: stopping tablet replica
I20260620 22:03:41.261838 5823 raft_consensus.cc:2258] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:41.261873 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 5390
I20260620 22:03:41.262035 5822 raft_consensus.cc:2229] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:41.262328 5823 ts_tablet_manager.cc:1905] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:41.263473 5822 raft_consensus.cc:2258] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:41.263643 5823 ts_tablet_manager.cc:1918] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:41.263712 5823 log.cc:1196] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/ec6be14c4d3b4d819b95bb8a02d2c7c7
I20260620 22:03:41.263918 5822 ts_tablet_manager.cc:1905] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:41.264011 5823 ts_tablet_manager.cc:1939] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P 6dd60dc5a83e49f39e3c27c5285dc4ba: Deleting consensus metadata
I20260620 22:03:41.264428 5314 catalog_manager.cc:4841] TS 6dd60dc5a83e49f39e3c27c5285dc4ba (127.1.55.194:36719): tablet ec6be14c4d3b4d819b95bb8a02d2c7c7 (table test-table [id=0396a95a363f4b3ba4559a7e84b49182]) successfully deleted
I20260620 22:03:41.265308 5822 ts_tablet_manager.cc:1918] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:41.265360 5822 log.cc:1196] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/ec6be14c4d3b4d819b95bb8a02d2c7c7
I20260620 22:03:41.265667 5822 ts_tablet_manager.cc:1939] T ec6be14c4d3b4d819b95bb8a02d2c7c7 P e326aa4887e14c51bd145d5ad5f5d78d: Deleting consensus metadata
I20260620 22:03:41.266014 5314 catalog_manager.cc:4841] TS e326aa4887e14c51bd145d5ad5f5d78d (127.1.55.195:40519): tablet ec6be14c4d3b4d819b95bb8a02d2c7c7 (table test-table [id=0396a95a363f4b3ba4559a7e84b49182]) successfully deleted
W20260620 22:03:41.268241 5315 connection.cc:535] client connection to 127.1.55.193:46091 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 22:03:41.268344 5315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 22:03:41.268712 5792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.268610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:46091 (local address 127.0.0.1:52548)
0620 22:03:41.268660 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.268691 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:46091: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260620 22:03:41.268815 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 5523
W20260620 22:03:41.268833 5315 catalog_manager.cc:4584] TS 28f8f440cfe247818cb8b90869517964 (127.1.55.193:46091): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ec6be14c4d3b4d819b95bb8a02d2c7c7: Network error: Client connection negotiation failed: client connection to 127.1.55.193:46091: connect: Connection refused (error 111)
I20260620 22:03:41.273578 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 5656
I20260620 22:03:41.277674 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 5297
2026-06-20T22:03:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2038 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-06-20T22:03:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:41Z Disabled control of system clock
I20260620 22:03:41.303632 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:35939
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:40607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:35939
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260620 22:03:41.377817 5828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:41.377974 5828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:41.377992 5828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:41.379005 5828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:41.379040 5828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:41.379052 5828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:41.379098 5828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:41.379114 5828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:41.380260 5828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:35939
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:35939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:41.380412 5828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:41.380684 5828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:41.384902 5836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:41.384987 5834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:41.384913 5833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:41.385006 5828 server_base.cc:1034] running on GCE node
I20260620 22:03:41.385305 5828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:41.385596 5828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:41.386734 5828 hybrid_clock.cc:648] HybridClock initialized: now 1781993021386721 us; error 28 us; skew 500 ppm
I20260620 22:03:41.387792 5828 webserver.cc:460] Webserver started at http://127.1.55.254:41547/ using document root <none> and password file <none>
I20260620 22:03:41.387955 5828 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:41.387992 5828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:41.388078 5828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:41.388967 5828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "0411ea17b9ae450c8b6b8ea5df75d895"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "d827967636c652dfbcbfc77f3e8b5d13"
server_key_iv: "04a89aea88b1c339de4f37a4b2390834"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.389237 5828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "0411ea17b9ae450c8b6b8ea5df75d895"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "d827967636c652dfbcbfc77f3e8b5d13"
server_key_iv: "04a89aea88b1c339de4f37a4b2390834"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.390440 5828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:03:41.391042 5842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.391218 5828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:41.391299 5828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "0411ea17b9ae450c8b6b8ea5df75d895"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "d827967636c652dfbcbfc77f3e8b5d13"
server_key_iv: "04a89aea88b1c339de4f37a4b2390834"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.391342 5828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:41.394196 5828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:41.394392 5828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:41.394505 5828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:41.398028 5828 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:35939
I20260620 22:03:41.398072 5894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:35939 every 8 connection(s)
I20260620 22:03:41.398285 5828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:41.398784 5895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:41.401044 5895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895: Bootstrap starting.
I20260620 22:03:41.401592 5895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:41.401854 5895 log.cc:824] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:41.402424 5895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895: No bootstrap required, opened a new log
I20260620 22:03:41.403745 5895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0411ea17b9ae450c8b6b8ea5df75d895" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 35939 } }
I20260620 22:03:41.403851 5895 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:41.403891 5895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0411ea17b9ae450c8b6b8ea5df75d895, State: Initialized, Role: FOLLOWER
I20260620 22:03:41.404006 5895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0411ea17b9ae450c8b6b8ea5df75d895" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 35939 } }
I20260620 22:03:41.404057 5895 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:41.404074 5895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:41.404136 5895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:41.404562 5895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0411ea17b9ae450c8b6b8ea5df75d895" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 35939 } }
I20260620 22:03:41.404656 5895 leader_election.cc:302] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0411ea17b9ae450c8b6b8ea5df75d895; no voters:
I20260620 22:03:41.404806 5895 leader_election.cc:288] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:41.404858 5898 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:41.405004 5898 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [term 1 LEADER]: Becoming Leader. State: Replica: 0411ea17b9ae450c8b6b8ea5df75d895, State: Running, Role: LEADER
I20260620 22:03:41.405041 5895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:41.405083 5898 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0411ea17b9ae450c8b6b8ea5df75d895" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 35939 } }
I20260620 22:03:41.405418 5899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0411ea17b9ae450c8b6b8ea5df75d895" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0411ea17b9ae450c8b6b8ea5df75d895" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 35939 } } }
I20260620 22:03:41.405630 5899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:41.405673 5900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0411ea17b9ae450c8b6b8ea5df75d895. Latest consensus state: current_term: 1 leader_uuid: "0411ea17b9ae450c8b6b8ea5df75d895" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0411ea17b9ae450c8b6b8ea5df75d895" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 35939 } } }
I20260620 22:03:41.405751 5900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:41.406057 5907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:41.406512 5907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:41.407226 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 5828
I20260620 22:03:41.407295 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:41.407464 1247 external_mini_cluster.cc:1428] Setting key f20dbc5c1cec78f59695ed5514a17739
I20260620 22:03:41.408191 5907 catalog_manager.cc:1347] Generated new cluster ID: 7f113386ff4f44338700cd41fc869aa0
I20260620 22:03:41.408258 5907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:41.409689 5918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.407887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51408 (local address 127.1.55.254:35939)
0620 22:03:41.408258 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.408272 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.408301 (+ 29us) server_negotiation.cc:407] Connection header received
0620 22:03:41.408416 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.408424 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.408464 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.408612 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.409241 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.409244 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.409244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.409248 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.409289 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.409302 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.409372 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.409438 (+ 66us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.409509 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":73,"threads_started":1}
I20260620 22:03:41.418654 5907 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:41.418778 5907 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:41.421553 5907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895: Generated new TSK 0
I20260620 22:03:41.421712 5907 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:03:41.427204 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:35939
--builtin_ntp_servers=127.1.55.212:40607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260620 22:03:41.500185 5919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:41.500355 5919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:41.500373 5919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:41.501441 5919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:41.501529 5919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:41.501585 5919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:41.502775 5919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:35939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:41.502996 5919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:41.503260 5919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:41.508610 5925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:41.508608 5927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:41.508752 5924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:41.509012 5919 server_base.cc:1034] running on GCE node
I20260620 22:03:41.509181 5919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:41.509392 5919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:41.510546 5919 hybrid_clock.cc:648] HybridClock initialized: now 1781993021510540 us; error 32 us; skew 500 ppm
I20260620 22:03:41.511848 5919 webserver.cc:460] Webserver started at http://127.1.55.193:33697/ using document root <none> and password file <none>
I20260620 22:03:41.512076 5919 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:41.512140 5919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:41.512259 5919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:41.513424 5919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "3f1dcbe159a94fd88e204c9791ad1c5e"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "3eb924453c5b8d8a1fc257cb98fc47d5"
server_key_iv: "4b60c16503fd766aa9a4d64d1ebf8c9b"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.513796 5919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "3f1dcbe159a94fd88e204c9791ad1c5e"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "3eb924453c5b8d8a1fc257cb98fc47d5"
server_key_iv: "4b60c16503fd766aa9a4d64d1ebf8c9b"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.515311 5919 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:41.516258 5933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.516453 5919 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:41.516530 5919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "3f1dcbe159a94fd88e204c9791ad1c5e"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "3eb924453c5b8d8a1fc257cb98fc47d5"
server_key_iv: "4b60c16503fd766aa9a4d64d1ebf8c9b"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.516600 5919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:41.520512 5919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:41.520735 5919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:41.520836 5919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:41.521001 5919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:41.521250 5919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:41.521282 5919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.521306 5919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:41.521327 5919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.527913 5919 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:46191
I20260620 22:03:41.527979 6046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:46191 every 8 connection(s)
I20260620 22:03:41.528275 5919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:41.530683 5918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.528901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:55989 (local address 127.1.55.254:35939)
0620 22:03:41.528967 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.528969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.529116 (+ 147us) server_negotiation.cc:407] Connection header received
0620 22:03:41.529459 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.529460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.529465 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.529556 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.530504 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.530505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.530505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.530508 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.530520 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.530523 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.530571 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.530624 (+ 53us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.530636 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 22:03:41.530834 6049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.528864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:35939 (local address 127.1.55.193:55989)
0620 22:03:41.529018 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.529045 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.529391 (+ 346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.529612 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.529615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.529621 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:41.530387 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:03:41.530387 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:41.530410 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:03:41.530434 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:41.530563 (+ 129us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:41.530565 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:41.530567 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.530621 (+ 54us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.530661 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":85,"threads_started":1}
I20260620 22:03:41.531286 6047 heartbeater.cc:347] Connected to a master server at 127.1.55.254:35939
I20260620 22:03:41.531354 6047 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:41.531442 6047 heartbeater.cc:511] Master 127.1.55.254:35939 requested a full tablet report, sending...
I20260620 22:03:41.531822 5859 ts_manager.cc:194] Registered new tserver with Master: 3f1dcbe159a94fd88e204c9791ad1c5e (127.1.55.193:46191)
I20260620 22:03:41.531831 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 5919
I20260620 22:03:41.531894 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:41.532105 1247 external_mini_cluster.cc:1428] Setting key 14930e6f1671a7a035e87de1b2d66dff
I20260620 22:03:41.532914 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:35939
--builtin_ntp_servers=127.1.55.212:40607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260620 22:03:41.609668 6050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:41.609869 6050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:41.609903 6050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:41.610970 6050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:41.611030 6050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:41.611073 6050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:41.612306 6050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:35939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:41.612569 6050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:41.612820 6050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:41.617389 6056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:41.617411 6058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:41.617506 6050 server_base.cc:1034] running on GCE node
W20260620 22:03:41.617405 6055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:41.617784 6050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:41.617985 6050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:41.619112 6050 hybrid_clock.cc:648] HybridClock initialized: now 1781993021619095 us; error 32 us; skew 500 ppm
I20260620 22:03:41.620309 6050 webserver.cc:460] Webserver started at http://127.1.55.194:38135/ using document root <none> and password file <none>
I20260620 22:03:41.620522 6050 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:41.620570 6050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:41.620676 6050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:41.621661 6050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "7cb036cf9c1449d3a880921aa976833c"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "4f0095429913b775d7552025402f356d"
server_key_iv: "110edaaf9093774782c1046ced9cac9e"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.621997 6050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "7cb036cf9c1449d3a880921aa976833c"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "4f0095429913b775d7552025402f356d"
server_key_iv: "110edaaf9093774782c1046ced9cac9e"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.623174 6050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:41.623838 6064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.623986 6050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:41.624073 6050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "7cb036cf9c1449d3a880921aa976833c"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "4f0095429913b775d7552025402f356d"
server_key_iv: "110edaaf9093774782c1046ced9cac9e"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.624150 6050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:41.627393 6050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:41.627674 6050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:41.627810 6050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:41.628005 6050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:41.628280 6050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:41.628331 6050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.628368 6050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:41.628394 6050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.633512 6050 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:46355
I20260620 22:03:41.633554 6177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:46355 every 8 connection(s)
I20260620 22:03:41.633833 6050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:03:41.636484 5918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.634436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:35451 (local address 127.1.55.254:35939)
0620 22:03:41.634476 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.634478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.634735 (+ 257us) server_negotiation.cc:407] Connection header received
0620 22:03:41.635181 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.635183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.635189 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.635226 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.636263 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.636265 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.636265 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.636269 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.636283 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.636287 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.636341 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.636408 (+ 67us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.636421 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:03:41.636646 6180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.634422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:35939 (local address 127.1.55.194:35451)
0620 22:03:41.634629 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.634668 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.635074 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.635292 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.635296 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.635305 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:41.636106 (+ 801us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:03:41.636106 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:41.636143 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:03:41.636166 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:41.636340 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:41.636345 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:41.636348 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.636416 (+ 68us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.636465 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":73,"threads_started":1}
I20260620 22:03:41.636909 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 6050
I20260620 22:03:41.636994 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:41.637164 1247 external_mini_cluster.cc:1428] Setting key 652abf68b3399d5ffd7f0a0f6a051f47
I20260620 22:03:41.637295 6178 heartbeater.cc:347] Connected to a master server at 127.1.55.254:35939
I20260620 22:03:41.637378 6178 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:41.637614 6178 heartbeater.cc:511] Master 127.1.55.254:35939 requested a full tablet report, sending...
I20260620 22:03:41.638015 5859 ts_manager.cc:194] Registered new tserver with Master: 7cb036cf9c1449d3a880921aa976833c (127.1.55.194:46355)
I20260620 22:03:41.638265 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:35939
--builtin_ntp_servers=127.1.55.212:40607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260620 22:03:41.712033 6181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:41.712248 6181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:41.712281 6181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:41.713376 6181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:41.713435 6181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:41.713479 6181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:41.714761 6181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:35939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:41.715014 6181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:41.715276 6181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:41.719750 6186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:41.719750 6189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:41.719834 6181 server_base.cc:1034] running on GCE node
W20260620 22:03:41.719732 6187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:41.720224 6181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:41.720412 6181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:41.721526 6181 hybrid_clock.cc:648] HybridClock initialized: now 1781993021721512 us; error 39 us; skew 500 ppm
I20260620 22:03:41.722613 6181 webserver.cc:460] Webserver started at http://127.1.55.195:42517/ using document root <none> and password file <none>
I20260620 22:03:41.722816 6181 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:41.722855 6181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:41.722976 6181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:41.723927 6181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "0c46e387126345219b31977a5f55bcb0"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "d6328b24cfa1684c478703ef7c458426"
server_key_iv: "4a54cd28a65661efe4cd720060d0b122"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.724258 6181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "0c46e387126345219b31977a5f55bcb0"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "d6328b24cfa1684c478703ef7c458426"
server_key_iv: "4a54cd28a65661efe4cd720060d0b122"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.725445 6181 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:03:41.726198 6195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.726373 6181 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:41.726475 6181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "0c46e387126345219b31977a5f55bcb0"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "d6328b24cfa1684c478703ef7c458426"
server_key_iv: "4a54cd28a65661efe4cd720060d0b122"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.726565 6181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:41.729866 6181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:41.730091 6181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:41.730224 6181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:41.730417 6181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:41.730695 6181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:41.730746 6181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.730780 6181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:41.730808 6181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.736091 6181 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:44835
I20260620 22:03:41.736158 6308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:44835 every 8 connection(s)
I20260620 22:03:41.736438 6181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:03:41.738771 5918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.737019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:47643 (local address 127.1.55.254:35939)
0620 22:03:41.737059 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.737061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.737255 (+ 194us) server_negotiation.cc:407] Connection header received
0620 22:03:41.737629 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.737630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.737635 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.737680 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.738609 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.738611 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.738611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.738615 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.738626 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.738630 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.738674 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.738715 (+ 41us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.738725 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:03:41.738942 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.737016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:35939 (local address 127.1.55.195:47643)
0620 22:03:41.737156 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.737182 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.737553 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.737720 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.737723 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.737729 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:41.738485 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:03:41.738485 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:41.738514 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:03:41.738544 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:41.738671 (+ 127us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:41.738673 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:41.738675 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.738718 (+ 43us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.738754 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":76,"threads_started":1}
I20260620 22:03:41.739341 6309 heartbeater.cc:347] Connected to a master server at 127.1.55.254:35939
I20260620 22:03:41.739414 6309 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:41.739499 6309 heartbeater.cc:511] Master 127.1.55.254:35939 requested a full tablet report, sending...
I20260620 22:03:41.739800 5859 ts_manager.cc:194] Registered new tserver with Master: 0c46e387126345219b31977a5f55bcb0 (127.1.55.195:44835)
I20260620 22:03:41.742481 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 6181
I20260620 22:03:41.742551 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:41.742718 1247 external_mini_cluster.cc:1428] Setting key fc18a10ee58b42666dad29c5566fae0c
I20260620 22:03:41.743350 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:03:41.745283 5918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.744451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42510 (local address 127.1.55.254:35939)
0620 22:03:41.744504 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.744506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.744604 (+ 98us) server_negotiation.cc:407] Connection header received
0620 22:03:41.744649 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.744650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.744653 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.744694 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.745139 (+ 445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.745139 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.745140 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.745143 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.745155 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.745157 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.745203 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.745236 (+ 33us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.745246 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 22:03:41.746641 5859 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:41.748018 5859 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:41.751626 6321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.749878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:46191 (local address 127.0.0.1:55758)
0620 22:03:41.750142 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.750150 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.750210 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.750575 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.750576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.750578 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:41.751254 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:03:41.751255 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:41.751260 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:03:41.751269 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:41.751500 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:41.751506 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:41.751508 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.751549 (+ 41us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.751562 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":74,"threads_started":1}
I20260620 22:03:41.751631 6318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.750023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:46355 (local address 127.0.0.1:53372)
0620 22:03:41.750281 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.750289 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.750323 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.750479 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.750483 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.750487 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:41.750989 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:03:41.750990 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:41.751002 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:03:41.751020 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:41.751518 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:41.751519 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:41.751519 (+ 0us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.751579 (+ 60us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.751588 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":72,"threads_started":1}
I20260620 22:03:41.751720 6322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.750106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53372 (local address 127.1.55.194:46355)
0620 22:03:41.750275 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.750280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.750321 (+ 41us) server_negotiation.cc:407] Connection header received
0620 22:03:41.750376 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.750391 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.750399 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.750468 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.751391 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.751396 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.751396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.751400 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.751428 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.751445 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.751497 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.751600 (+ 103us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.751618 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":82,"threads_started":1}
I20260620 22:03:41.751879 6320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.749977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55758 (local address 127.1.55.193:46191)
0620 22:03:41.750442 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.750445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.750453 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:03:41.750474 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.750476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.750482 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.750544 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.751345 (+ 801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.751353 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.751353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.751358 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.751390 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.751416 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.751737 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.751759 (+ 22us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.751775 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":82,"threads_started":1}
I20260620 22:03:41.752071 6319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.749893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.1.55.195:44835)
0620 22:03:41.750812 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.750816 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.750823 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:03:41.750840 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.750842 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.750848 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.750913 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.751476 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.751482 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.751482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.751486 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.751518 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.751535 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.751614 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.751998 (+ 384us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.752011 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":893,"thread_start_us":56,"threads_started":1}
I20260620 22:03:41.752197 6317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.749843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:44835 (local address 127.0.0.1:38078)
0620 22:03:41.750006 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.750039 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.750086 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.751120 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.751120 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.751122 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:41.751399 (+ 277us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:03:41.751399 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:41.751402 (+ 3us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:03:41.751408 (+ 6us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:41.751638 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:41.751639 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:41.751640 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.751863 (+ 223us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.751876 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":63,"threads_started":1}
I20260620 22:03:41.752346 6112 tablet_service.cc:1467] Processing CreateTablet for tablet 5143ae7d774140289ed5bee20c98e48e (DEFAULT_TABLE table=test-table [id=bcee08c1882e4d2ba762eb8dcb80af1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:41.752511 5962 tablet_service.cc:1467] Processing CreateTablet for tablet 5143ae7d774140289ed5bee20c98e48e (DEFAULT_TABLE table=test-table [id=bcee08c1882e4d2ba762eb8dcb80af1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:41.752666 6112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5143ae7d774140289ed5bee20c98e48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:41.752846 5962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5143ae7d774140289ed5bee20c98e48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:41.752801 6243 tablet_service.cc:1467] Processing CreateTablet for tablet 5143ae7d774140289ed5bee20c98e48e (DEFAULT_TABLE table=test-table [id=bcee08c1882e4d2ba762eb8dcb80af1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:41.753042 6243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5143ae7d774140289ed5bee20c98e48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:41.755154 6323 tablet_bootstrap.cc:492] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: Bootstrap starting.
I20260620 22:03:41.755767 6323 tablet_bootstrap.cc:654] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:41.755832 6325 tablet_bootstrap.cc:492] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e: Bootstrap starting.
I20260620 22:03:41.756175 6324 tablet_bootstrap.cc:492] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: Bootstrap starting.
I20260620 22:03:41.756191 6323 log.cc:824] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:41.756508 6325 tablet_bootstrap.cc:654] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:41.756793 6324 tablet_bootstrap.cc:654] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:41.756815 6325 log.cc:824] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:41.757112 6323 tablet_bootstrap.cc:492] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: No bootstrap required, opened a new log
I20260620 22:03:41.757120 6324 log.cc:824] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:41.757191 6323 ts_tablet_manager.cc:1397] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:41.757601 6325 tablet_bootstrap.cc:492] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e: No bootstrap required, opened a new log
I20260620 22:03:41.757666 6325 ts_tablet_manager.cc:1397] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:41.757807 6324 tablet_bootstrap.cc:492] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: No bootstrap required, opened a new log
I20260620 22:03:41.757872 6324 ts_tablet_manager.cc:1397] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:41.759629 6324 raft_consensus.cc:348] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.759759 6324 raft_consensus.cc:374] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:41.759673 6323 raft_consensus.cc:348] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.759799 6324 raft_consensus.cc:729] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c46e387126345219b31977a5f55bcb0, State: Initialized, Role: FOLLOWER
I20260620 22:03:41.759819 6323 raft_consensus.cc:374] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:41.759859 6323 raft_consensus.cc:729] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cb036cf9c1449d3a880921aa976833c, State: Initialized, Role: FOLLOWER
I20260620 22:03:41.759897 6324 consensus_queue.cc:260] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.759967 6323 consensus_queue.cc:260] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.760125 6324 ts_tablet_manager.cc:1428] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 22:03:41.760169 6309 heartbeater.cc:503] Master 127.1.55.254:35939 was elected leader, sending a full tablet report...
I20260620 22:03:41.760193 6323 ts_tablet_manager.cc:1428] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:03:41.760288 6178 heartbeater.cc:503] Master 127.1.55.254:35939 was elected leader, sending a full tablet report...
I20260620 22:03:41.760049 6325 raft_consensus.cc:348] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.760485 6325 raft_consensus.cc:374] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:41.760533 6325 raft_consensus.cc:729] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1dcbe159a94fd88e204c9791ad1c5e, State: Initialized, Role: FOLLOWER
I20260620 22:03:41.760625 6325 consensus_queue.cc:260] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.760835 6325 ts_tablet_manager.cc:1428] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:03:41.760970 6047 heartbeater.cc:503] Master 127.1.55.254:35939 was elected leader, sending a full tablet report...
W20260620 22:03:41.778847 6048 tablet.cc:2369] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:03:41.829171 6329 raft_consensus.cc:482] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:41.829253 6329 raft_consensus.cc:504] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.829648 6329 leader_election.cc:288] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1dcbe159a94fd88e204c9791ad1c5e (127.1.55.193:46191), 7cb036cf9c1449d3a880921aa976833c (127.1.55.194:46355)
I20260620 22:03:41.830811 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.829818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:46191 (local address 127.1.55.195:39497)
0620 22:03:41.829857 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.829868 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.829899 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.830064 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.830065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.830067 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:41.830533 (+ 466us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:03:41.830533 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:41.830539 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:03:41.830549 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:41.830695 (+ 146us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:41.830696 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:41.830697 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.830736 (+ 39us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.830749 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260620 22:03:41.830811 6320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.829861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:39497 (local address 127.1.55.193:46191)
0620 22:03:41.829899 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.829901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.829910 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:41.829979 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.829979 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.829985 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.830049 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.830623 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.830624 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.830624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.830628 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.830643 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.830646 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.830689 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.830736 (+ 47us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.830749 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:03:41.831017 6332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.829818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:46355 (local address 127.1.55.195:42285)
0620 22:03:41.830032 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.830041 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:41.830097 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:41.830228 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:41.830229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:41.830233 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:41.830693 (+ 460us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:03:41.830693 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:41.830699 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:03:41.830710 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:41.830863 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:41.830863 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:41.830864 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:03:41.830908 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 22:03:41.830921 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":44,"thread_start_us":104,"threads_started":1}
I20260620 22:03:41.831122 6322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.829871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:42285 (local address 127.1.55.194:46355)
0620 22:03:41.829905 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.829907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.830108 (+ 201us) server_negotiation.cc:407] Connection header received
0620 22:03:41.830136 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.830138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.830144 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.830203 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.830791 (+ 588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.830792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.830793 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.830797 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.830810 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.830814 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.830856 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.831029 (+ 173us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.831041 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:03:41.831179 6001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5143ae7d774140289ed5bee20c98e48e" candidate_uuid: "0c46e387126345219b31977a5f55bcb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" is_pre_election: true
I20260620 22:03:41.831313 6001 raft_consensus.cc:2454] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c46e387126345219b31977a5f55bcb0 in term 0.
I20260620 22:03:41.831472 6132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5143ae7d774140289ed5bee20c98e48e" candidate_uuid: "0c46e387126345219b31977a5f55bcb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cb036cf9c1449d3a880921aa976833c" is_pre_election: true
I20260620 22:03:41.831516 6196 leader_election.cc:302] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c46e387126345219b31977a5f55bcb0, 3f1dcbe159a94fd88e204c9791ad1c5e; no voters:
I20260620 22:03:41.831620 6132 raft_consensus.cc:2454] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c46e387126345219b31977a5f55bcb0 in term 0.
I20260620 22:03:41.831650 6329 raft_consensus.cc:2781] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:41.831686 6329 raft_consensus.cc:482] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:41.831712 6329 raft_consensus.cc:3037] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:41.832363 6329 raft_consensus.cc:504] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.832485 6329 leader_election.cc:288] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1dcbe159a94fd88e204c9791ad1c5e (127.1.55.193:46191), 7cb036cf9c1449d3a880921aa976833c (127.1.55.194:46355)
I20260620 22:03:41.832607 6001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5143ae7d774140289ed5bee20c98e48e" candidate_uuid: "0c46e387126345219b31977a5f55bcb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e"
I20260620 22:03:41.832598 6132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5143ae7d774140289ed5bee20c98e48e" candidate_uuid: "0c46e387126345219b31977a5f55bcb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7cb036cf9c1449d3a880921aa976833c"
I20260620 22:03:41.832652 6001 raft_consensus.cc:3037] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:41.832662 6132 raft_consensus.cc:3037] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:41.833228 6001 raft_consensus.cc:2454] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c46e387126345219b31977a5f55bcb0 in term 1.
I20260620 22:03:41.833232 6132 raft_consensus.cc:2454] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c46e387126345219b31977a5f55bcb0 in term 1.
I20260620 22:03:41.833400 6199 leader_election.cc:302] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c46e387126345219b31977a5f55bcb0, 7cb036cf9c1449d3a880921aa976833c; no voters:
I20260620 22:03:41.833509 6329 raft_consensus.cc:2781] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:41.833632 6329 raft_consensus.cc:686] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 1 LEADER]: Becoming Leader. State: Replica: 0c46e387126345219b31977a5f55bcb0, State: Running, Role: LEADER
I20260620 22:03:41.833714 6329 consensus_queue.cc:237] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } }
I20260620 22:03:41.834375 5859 catalog_manager.cc:5495] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c46e387126345219b31977a5f55bcb0 (127.1.55.195). New cstate: current_term: 1 leader_uuid: "0c46e387126345219b31977a5f55bcb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c46e387126345219b31977a5f55bcb0" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 } health_report { overall_health: UNKNOWN } } }
I20260620 22:03:41.846113 6319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.845197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38082 (local address 127.1.55.195:44835)
0620 22:03:41.845239 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:41.845242 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:41.845280 (+ 38us) server_negotiation.cc:407] Connection header received
0620 22:03:41.845354 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:41.845354 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:41.845370 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:41.845435 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:41.845916 (+ 481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:41.845917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:41.845917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:41.845922 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:41.845934 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:41.845938 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:41.845993 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:41.846039 (+ 46us) server_negotiation.cc:299] Negotiation successful
0620 22:03:41.846052 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:03:41.847568 6001 raft_consensus.cc:1261] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e [term 1 FOLLOWER]: Refusing update from remote peer 0c46e387126345219b31977a5f55bcb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:41.847575 6132 raft_consensus.cc:1261] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 1 FOLLOWER]: Refusing update from remote peer 0c46e387126345219b31977a5f55bcb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:41.847929 6333 consensus_queue.cc:1035] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1dcbe159a94fd88e204c9791ad1c5e" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:41.848037 6329 consensus_queue.cc:1035] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7cb036cf9c1449d3a880921aa976833c" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:41.850126 6336 mvcc.cc:205] Tried to move back new op lower bound from 7299043417485266944 to 7299043417431441408. Current Snapshot: MvccSnapshot[applied={T|T < 7299043417485266944}]
I20260620 22:03:41.852109 5858 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:41.852192 5858 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:41.852824 5858 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0411ea17b9ae450c8b6b8ea5df75d895: Sending DeleteTablet for 3 replicas of tablet 5143ae7d774140289ed5bee20c98e48e
I20260620 22:03:41.853113 5962 tablet_service.cc:1514] Processing DeleteTablet for tablet 5143ae7d774140289ed5bee20c98e48e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:41 UTC) from {username='slave'} at 127.0.0.1:55758
I20260620 22:03:41.853135 6243 tablet_service.cc:1514] Processing DeleteTablet for tablet 5143ae7d774140289ed5bee20c98e48e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:41 UTC) from {username='slave'} at 127.0.0.1:38078
I20260620 22:03:41.853186 6112 tablet_service.cc:1514] Processing DeleteTablet for tablet 5143ae7d774140289ed5bee20c98e48e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:41 UTC) from {username='slave'} at 127.0.0.1:53372
I20260620 22:03:41.853348 6346 tablet_replica.cc:330] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: stopping tablet replica
I20260620 22:03:41.853384 6345 tablet_replica.cc:330] T 5143ae7d774140289ed5bee20c98e48e P 3f1dcbe159a94fd88e204c9791ad1c5e: stopping tablet replica
I20260620 22:03:41.853495 6346 raft_consensus.cc:2229] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:03:41.853550 6347 tablet_replica.cc:330] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: stopping tablet replica
I20260620 22:03:41.853631 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 5919
I20260620 22:03:41.853642 6347 raft_consensus.cc:2229] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:41.853720 6347 raft_consensus.cc:2258] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:41.854521 6346 raft_consensus.cc:2258] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:41.855126 6346 ts_tablet_manager.cc:1905] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:41.855821 6347 ts_tablet_manager.cc:1905] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:41.857076 6346 ts_tablet_manager.cc:1918] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:41.857189 6346 log.cc:1196] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/5143ae7d774140289ed5bee20c98e48e
I20260620 22:03:41.857344 6347 ts_tablet_manager.cc:1918] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:41.857431 6347 log.cc:1196] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/5143ae7d774140289ed5bee20c98e48e
I20260620 22:03:41.857649 6346 ts_tablet_manager.cc:1939] T 5143ae7d774140289ed5bee20c98e48e P 0c46e387126345219b31977a5f55bcb0: Deleting consensus metadata
I20260620 22:03:41.857705 6347 ts_tablet_manager.cc:1939] T 5143ae7d774140289ed5bee20c98e48e P 7cb036cf9c1449d3a880921aa976833c: Deleting consensus metadata
I20260620 22:03:41.858080 5846 catalog_manager.cc:4841] TS 0c46e387126345219b31977a5f55bcb0 (127.1.55.195:44835): tablet 5143ae7d774140289ed5bee20c98e48e (table test-table [id=bcee08c1882e4d2ba762eb8dcb80af1c]) successfully deleted
I20260620 22:03:41.858166 5846 catalog_manager.cc:4841] TS 7cb036cf9c1449d3a880921aa976833c (127.1.55.194:46355): tablet 5143ae7d774140289ed5bee20c98e48e (table test-table [id=bcee08c1882e4d2ba762eb8dcb80af1c]) successfully deleted
W20260620 22:03:41.858677 5843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:46191 (error 108)
I20260620 22:03:41.859141 6318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:41.859030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:46191 (local address 127.0.0.1:55768)
0620 22:03:41.859071 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:41.859110 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:46191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260620 22:03:41.859206 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 6050
W20260620 22:03:41.859277 5843 catalog_manager.cc:4584] TS 3f1dcbe159a94fd88e204c9791ad1c5e (127.1.55.193:46191): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5143ae7d774140289ed5bee20c98e48e: Network error: Client connection negotiation failed: client connection to 127.1.55.193:46191: connect: Connection refused (error 111)
I20260620 22:03:41.864158 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 6181
I20260620 22:03:41.868121 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 5828
2026-06-20T22:03:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (588 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260620 22:03:41.886018 1247 mini_oidc.cc:152] Starting JWKS server
I20260620 22:03:41.886904 1247 webserver.cc:460] Webserver started at https://127.0.0.1:35499/ using document root <none> and password file <none>
I20260620 22:03:41.886966 1247 mini_oidc.cc:189] Starting OIDC Discovery server
I20260620 22:03:41.887077 1247 webserver.cc:460] Webserver started at http://127.0.0.1:44885/ using document root <none> and password file <none>
2026-06-20T22:03:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:41Z Disabled control of system clock
I20260620 22:03:41.894321 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:33509
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:42831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:33509
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35499/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/testchainca.cert with env {}
W20260620 22:03:41.968218 6354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:41.968420 6354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:41.968456 6354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:41.969640 6354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:41.969677 6354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:41.969689 6354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:41.969702 6354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:41.969713 6354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260620 22:03:41.969724 6354 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260620 22:03:41.969735 6354 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35499/jwks.json
I20260620 22:03:41.971083 6354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:33509
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:33509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35499/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:41.971253 6354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:41.971388 6354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:41.975735 6360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:41.975785 6362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:41.975803 6359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:41.975893 6354 server_base.cc:1034] running on GCE node
I20260620 22:03:41.976248 6354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:41.976519 6354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:41.977654 6354 hybrid_clock.cc:648] HybridClock initialized: now 1781993021977641 us; error 33 us; skew 500 ppm
I20260620 22:03:41.978850 6354 webserver.cc:460] Webserver started at http://127.1.55.254:44777/ using document root <none> and password file <none>
I20260620 22:03:41.979090 6354 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:41.979136 6354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:41.979254 6354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:41.980136 6354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "c38f60df426544329c01991f389d0cfc"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "011f882fc9e26a50d01177d7cf136da5"
server_key_iv: "8174c3ca9b1284a8c80f8c38f97a2d74"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.980443 6354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "c38f60df426544329c01991f389d0cfc"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "011f882fc9e26a50d01177d7cf136da5"
server_key_iv: "8174c3ca9b1284a8c80f8c38f97a2d74"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.981590 6354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:03:41.982241 6368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.982411 6354 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:41.982487 6354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "c38f60df426544329c01991f389d0cfc"
format_stamp: "Formatted at 2026-06-20 22:03:41 on dist-test-slave-xw35"
server_key: "011f882fc9e26a50d01177d7cf136da5"
server_key_iv: "8174c3ca9b1284a8c80f8c38f97a2d74"
server_key_version: "encryptionkey@0"
I20260620 22:03:41.982553 6354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:41.998669 6354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:41.998895 6354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:41.999023 6354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:42.002391 6354 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:33509
I20260620 22:03:42.002440 6420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:33509 every 8 connection(s)
I20260620 22:03:42.002703 6354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:42.003504 6421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:42.005453 6421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc: Bootstrap starting.
I20260620 22:03:42.006027 6421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:42.006256 6421 log.cc:824] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:42.006819 6421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc: No bootstrap required, opened a new log
I20260620 22:03:42.008003 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 6354
I20260620 22:03:42.008118 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:42.008308 1247 external_mini_cluster.cc:1428] Setting key 2b35a205e3c8407afa3b5dfde539478f
I20260620 22:03:42.008684 6421 raft_consensus.cc:348] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38f60df426544329c01991f389d0cfc" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33509 } }
I20260620 22:03:42.008850 6421 raft_consensus.cc:374] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:42.008889 6421 raft_consensus.cc:729] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c38f60df426544329c01991f389d0cfc, State: Initialized, Role: FOLLOWER
I20260620 22:03:42.009018 6421 consensus_queue.cc:260] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38f60df426544329c01991f389d0cfc" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33509 } }
I20260620 22:03:42.009093 6421 raft_consensus.cc:388] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:42.009121 6421 raft_consensus.cc:482] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:42.009174 6421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:42.009824 6421 raft_consensus.cc:504] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38f60df426544329c01991f389d0cfc" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33509 } }
I20260620 22:03:42.009923 6421 leader_election.cc:302] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c38f60df426544329c01991f389d0cfc; no voters:
I20260620 22:03:42.010051 6421 leader_election.cc:288] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:42.010135 6426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:42.010258 6426 raft_consensus.cc:686] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [term 1 LEADER]: Becoming Leader. State: Replica: c38f60df426544329c01991f389d0cfc, State: Running, Role: LEADER
I20260620 22:03:42.010293 6421 sys_catalog.cc:564] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:42.010330 6426 consensus_queue.cc:237] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38f60df426544329c01991f389d0cfc" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33509 } }
I20260620 22:03:42.010603 6426 sys_catalog.cc:455] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c38f60df426544329c01991f389d0cfc. Latest consensus state: current_term: 1 leader_uuid: "c38f60df426544329c01991f389d0cfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38f60df426544329c01991f389d0cfc" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33509 } } }
I20260620 22:03:42.010653 6426 sys_catalog.cc:458] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:42.010789 6427 sys_catalog.cc:455] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c38f60df426544329c01991f389d0cfc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c38f60df426544329c01991f389d0cfc" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33509 } } }
I20260620 22:03:42.010866 6427 sys_catalog.cc:458] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:42.011081 6433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:42.011544 6433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:42.013108 6433 catalog_manager.cc:1347] Generated new cluster ID: d231fb01c5c744abb1112d4fa76af509
I20260620 22:03:42.013151 6433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:42.014281 6425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:42.008772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52194 (local address 127.1.55.254:33509)
0620 22:03:42.008990 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:42.008998 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:42.009025 (+ 27us) server_negotiation.cc:407] Connection header received
0620 22:03:42.009138 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:42.009144 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:42.009221 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:42.009347 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:42.009510 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.011083 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.012162 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.012731 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.012937 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.013516 (+ 579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:42.013519 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:42.013519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:42.013715 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:42.013752 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:42.013764 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:42.013814 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:42.014020 (+ 206us) server_negotiation.cc:299] Negotiation successful
0620 22:03:42.014098 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":83,"threads_started":1}
I20260620 22:03:42.015125 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:03:42.021775 6433 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:42.022171 6433 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:42.031215 6433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c38f60df426544329c01991f389d0cfc: Generated new TSK 0
I20260620 22:03:42.031380 6433 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260620 22:03:42.050627 6451 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260620 22:03:42.050702 6451 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260620 22:03:42.050923 6425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:42.037095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52210 (local address 127.1.55.254:33509)
0620 22:03:42.037158 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:42.037159 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:42.037226 (+ 67us) server_negotiation.cc:407] Connection header received
0620 22:03:42.037320 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:42.037320 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:42.037329 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:42.037381 (+ 52us) server_negotiation.cc:226] Negotiated authn=JWT
0620 22:03:42.037585 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.038017 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.039091 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.039260 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.039301 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.039497 (+ 196us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0620 22:03:42.050751 (+ 11254us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0620 22:03:42.050862 (+ 111us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52210: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":44}
W20260620 22:03:42.050967 6425 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52210: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260620 22:03:42.051184 6450 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:03:42.036997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33509 (local address 127.0.0.1:52210)
0620 22:03:42.037151 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:42.037162 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:42.037227 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:42.037406 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:42.037406 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:42.037408 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0620 22:03:42.037514 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:42.037516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.038093 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.038094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:42.039017 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:42.039019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.039325 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.039326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:42.039384 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.039402 (+ 18us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0620 22:03:42.050849 (+ 11447us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0620 22:03:42.050921 (+ 72us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.55.254:33509: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":76,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.1.55.254:33509: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35499/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260620 22:03:42.051508 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 6354
2026-06-20T22:03:42Z chronyd exiting
I20260620 22:03:42.086524 1247 test_util.cc:175] -----------------------------------------------
I20260620 22:03:42.086571 1247 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781993001979103-1247-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (201 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260620 22:03:42.087167 1247 mini_oidc.cc:152] Starting JWKS server
I20260620 22:03:42.087730 1247 webserver.cc:460] Webserver started at https://127.0.0.1:36673/ using document root <none> and password file <none>
I20260620 22:03:42.087765 1247 mini_oidc.cc:189] Starting OIDC Discovery server
I20260620 22:03:42.087893 1247 webserver.cc:460] Webserver started at http://127.0.0.1:41333/ using document root <none> and password file <none>
2026-06-20T22:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:42Z Disabled control of system clock
I20260620 22:03:42.095213 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46409
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:39401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:46409
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36673/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/testchainca.cert with env {}
W20260620 22:03:42.170110 6457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:42.170269 6457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:42.170287 6457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:42.171265 6457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:42.171295 6457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:42.171307 6457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:42.171329 6457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:42.171339 6457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260620 22:03:42.171350 6457 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260620 22:03:42.171366 6457 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36673/jwks.json
I20260620 22:03:42.172597 6457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:39401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:46409
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36673/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:42.172750 6457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:42.172876 6457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:03:42.177342 6457 server_base.cc:1034] running on GCE node
W20260620 22:03:42.177241 6465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:42.177241 6463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:42.177281 6462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:42.177775 6457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:42.178061 6457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:42.179354 6457 hybrid_clock.cc:648] HybridClock initialized: now 1781993022179337 us; error 42 us; skew 500 ppm
I20260620 22:03:42.180501 6457 webserver.cc:460] Webserver started at http://127.1.55.254:40875/ using document root <none> and password file <none>
I20260620 22:03:42.180735 6457 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:42.180795 6457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:42.180909 6457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:42.181846 6457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "d6de5790784044dbb08dd1e2967ea5c3"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "73c4ccf9eb0732c3b696e4eea77abc3c"
server_key_iv: "7b1677564fa423b6e394e56feaa0e35d"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.182158 6457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "d6de5790784044dbb08dd1e2967ea5c3"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "73c4ccf9eb0732c3b696e4eea77abc3c"
server_key_iv: "7b1677564fa423b6e394e56feaa0e35d"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.183244 6457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:42.183846 6471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:42.184023 6457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:42.184103 6457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "d6de5790784044dbb08dd1e2967ea5c3"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "73c4ccf9eb0732c3b696e4eea77abc3c"
server_key_iv: "7b1677564fa423b6e394e56feaa0e35d"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.184175 6457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:42.194358 6457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:42.194586 6457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:42.194712 6457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:42.198217 6457 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:46409
I20260620 22:03:42.198242 6523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:46409 every 8 connection(s)
I20260620 22:03:42.198504 6457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:42.199347 6524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:42.201246 6524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3: Bootstrap starting.
I20260620 22:03:42.201795 6524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:42.202016 6524 log.cc:824] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:42.202623 6524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3: No bootstrap required, opened a new log
I20260620 22:03:42.203958 6524 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6de5790784044dbb08dd1e2967ea5c3" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46409 } }
I20260620 22:03:42.204074 6524 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:42.204094 6524 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6de5790784044dbb08dd1e2967ea5c3, State: Initialized, Role: FOLLOWER
I20260620 22:03:42.204180 6524 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6de5790784044dbb08dd1e2967ea5c3" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46409 } }
I20260620 22:03:42.204222 6524 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:42.204241 6524 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:42.204272 6524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:42.204696 6524 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6de5790784044dbb08dd1e2967ea5c3" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46409 } }
I20260620 22:03:42.204770 6524 leader_election.cc:302] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6de5790784044dbb08dd1e2967ea5c3; no voters:
I20260620 22:03:42.204906 6524 leader_election.cc:288] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:42.204944 6527 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:42.205085 6527 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [term 1 LEADER]: Becoming Leader. State: Replica: d6de5790784044dbb08dd1e2967ea5c3, State: Running, Role: LEADER
I20260620 22:03:42.205164 6524 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:42.205171 6527 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6de5790784044dbb08dd1e2967ea5c3" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46409 } }
I20260620 22:03:42.205562 6528 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6de5790784044dbb08dd1e2967ea5c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6de5790784044dbb08dd1e2967ea5c3" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46409 } } }
I20260620 22:03:42.205704 6528 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:42.205687 6529 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6de5790784044dbb08dd1e2967ea5c3. Latest consensus state: current_term: 1 leader_uuid: "d6de5790784044dbb08dd1e2967ea5c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6de5790784044dbb08dd1e2967ea5c3" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46409 } } }
I20260620 22:03:42.205904 6529 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:42.206276 6537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:42.206776 6537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:42.208173 6537 catalog_manager.cc:1347] Generated new cluster ID: cf64c06474c84d278f68625c6685658d
I20260620 22:03:42.208225 6537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:42.208743 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 6457
I20260620 22:03:42.208841 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:42.209005 1247 external_mini_cluster.cc:1428] Setting key 59eee6d3c12d18e99cbccec48d509616
I20260620 22:03:42.214210 6547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:42.209346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39764 (local address 127.1.55.254:46409)
0620 22:03:42.209500 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:42.209507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:42.209547 (+ 40us) server_negotiation.cc:407] Connection header received
0620 22:03:42.209693 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:42.209698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:42.209752 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:42.209874 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:42.210070 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.211245 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.212291 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.212805 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.212899 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.213554 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:42.213557 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:42.213557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:42.213727 (+ 170us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:42.213759 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:42.213770 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:42.213824 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:42.213906 (+ 82us) server_negotiation.cc:299] Negotiation successful
0620 22:03:42.214033 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":62,"threads_started":1}
I20260620 22:03:42.214974 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:03:42.233899 6537 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:42.234485 6537 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:42.238293 6537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6de5790784044dbb08dd1e2967ea5c3: Generated new TSK 0
I20260620 22:03:42.238443 6537 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260620 22:03:42.267266 6554 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260620 22:03:42.267321 6554 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260620 22:03:42.267565 6547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:42.246983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39768 (local address 127.1.55.254:46409)
0620 22:03:42.247032 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:42.247033 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:42.247066 (+ 33us) server_negotiation.cc:407] Connection header received
0620 22:03:42.247141 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:42.247141 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:42.247149 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:42.247193 (+ 44us) server_negotiation.cc:226] Negotiated authn=JWT
0620 22:03:42.247299 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.247749 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.248889 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.249062 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.249103 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.249275 (+ 172us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0620 22:03:42.267362 (+ 18087us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36673/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0620 22:03:42.267526 (+ 164us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39768: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36673/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":14}
W20260620 22:03:42.267625 6547 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39768: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36673/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260620 22:03:42.267678 6553 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:03:42.246774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46409 (local address 127.0.0.1:39768)
0620 22:03:42.247015 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:42.247024 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:42.247082 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:42.247201 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:42.247202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:42.247204 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0620 22:03:42.247246 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:42.247247 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.247838 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.247839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:42.248793 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:42.248796 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.249129 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.249130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:42.249185 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.249190 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0620 22:03:42.267487 (+ 18297us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36673/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0620 22:03:42.267588 (+ 101us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.55.254:46409: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36673/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":183,"threads_started":1}
I20260620 22:03:42.267904 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 6457
2026-06-20T22:03:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (217 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260620 22:03:42.305094 1247 mini_oidc.cc:152] Starting JWKS server
I20260620 22:03:42.305784 1247 webserver.cc:460] Webserver started at https://127.0.0.1:45661/ using document root <none> and password file <none>
I20260620 22:03:42.305824 1247 mini_oidc.cc:189] Starting OIDC Discovery server
I20260620 22:03:42.305928 1247 webserver.cc:460] Webserver started at http://127.0.0.1:46221/ using document root <none> and password file <none>
2026-06-20T22:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:42Z Disabled control of system clock
I20260620 22:03:42.312853 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:44305
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:42037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:44305
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45661/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260620 22:03:42.385743 6560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:42.385910 6560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:42.385931 6560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:42.387107 6560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:42.387145 6560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:42.387158 6560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:42.387171 6560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:42.387223 6560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260620 22:03:42.387239 6560 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260620 22:03:42.387265 6560 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45661/jwks.json
I20260620 22:03:42.388588 6560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:44305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:44305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45661/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:42.388841 6560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:42.389082 6560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:42.393332 6566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:42.393340 6565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:42.393357 6560 server_base.cc:1034] running on GCE node
W20260620 22:03:42.393340 6568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:42.393841 6560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:42.394044 6560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:42.395175 6560 hybrid_clock.cc:648] HybridClock initialized: now 1781993022395147 us; error 44 us; skew 500 ppm
I20260620 22:03:42.396323 6560 webserver.cc:460] Webserver started at http://127.1.55.254:36413/ using document root <none> and password file <none>
I20260620 22:03:42.396539 6560 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:42.396579 6560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:42.396694 6560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:42.397641 6560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "ba975e5843b34d92a83375099620a99c"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "f3ccbad5d2009a3b7dbe9222a70f34d5"
server_key_iv: "e37cba0ccb8a1bc88b6c7d724eaf2a64"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.397957 6560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "ba975e5843b34d92a83375099620a99c"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "f3ccbad5d2009a3b7dbe9222a70f34d5"
server_key_iv: "e37cba0ccb8a1bc88b6c7d724eaf2a64"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.399161 6560 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:42.399786 6574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:42.399933 6560 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:42.400019 6560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "ba975e5843b34d92a83375099620a99c"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "f3ccbad5d2009a3b7dbe9222a70f34d5"
server_key_iv: "e37cba0ccb8a1bc88b6c7d724eaf2a64"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.400089 6560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:42.410071 6560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:42.410324 6560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:42.410462 6560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:42.413769 6560 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:44305
I20260620 22:03:42.413793 6626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:44305 every 8 connection(s)
I20260620 22:03:42.414093 6560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:42.414637 6627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:42.416615 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 6560
I20260620 22:03:42.416699 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:42.416896 1247 external_mini_cluster.cc:1428] Setting key d9e690fff82ab0115794b8088d251eff
I20260620 22:03:42.416988 6627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c: Bootstrap starting.
I20260620 22:03:42.417655 6627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:42.417945 6627 log.cc:824] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:42.418629 6627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c: No bootstrap required, opened a new log
I20260620 22:03:42.420126 6627 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba975e5843b34d92a83375099620a99c" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 44305 } }
I20260620 22:03:42.420231 6627 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:42.420249 6627 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba975e5843b34d92a83375099620a99c, State: Initialized, Role: FOLLOWER
I20260620 22:03:42.420387 6627 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba975e5843b34d92a83375099620a99c" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 44305 } }
I20260620 22:03:42.420447 6627 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:42.420495 6627 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:42.420539 6627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:42.421120 6627 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba975e5843b34d92a83375099620a99c" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 44305 } }
I20260620 22:03:42.421227 6627 leader_election.cc:302] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba975e5843b34d92a83375099620a99c; no voters:
I20260620 22:03:42.421361 6627 leader_election.cc:288] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:42.421387 6632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:42.421492 6632 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [term 1 LEADER]: Becoming Leader. State: Replica: ba975e5843b34d92a83375099620a99c, State: Running, Role: LEADER
I20260620 22:03:42.421563 6632 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba975e5843b34d92a83375099620a99c" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 44305 } }
I20260620 22:03:42.421618 6627 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:42.421856 6634 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba975e5843b34d92a83375099620a99c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba975e5843b34d92a83375099620a99c" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 44305 } } }
I20260620 22:03:42.421849 6632 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba975e5843b34d92a83375099620a99c. Latest consensus state: current_term: 1 leader_uuid: "ba975e5843b34d92a83375099620a99c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba975e5843b34d92a83375099620a99c" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 44305 } } }
I20260620 22:03:42.422024 6632 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:42.422077 6630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:42.417282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36176 (local address 127.1.55.254:44305)
0620 22:03:42.417501 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:42.417508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:42.417537 (+ 29us) server_negotiation.cc:407] Connection header received
0620 22:03:42.418029 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:42.418036 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:42.418126 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:42.418238 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:42.418469 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.419294 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.420011 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.420479 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.420595 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.421161 (+ 566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:42.421165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:42.421165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:42.421349 (+ 184us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:42.421383 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:42.421406 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:42.421466 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:42.421718 (+ 252us) server_negotiation.cc:299] Negotiation successful
0620 22:03:42.421781 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":70,"threads_started":1}
I20260620 22:03:42.422578 6634 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:42.422739 6639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:42.422935 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:03:42.423398 6639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:42.424674 6639 catalog_manager.cc:1347] Generated new cluster ID: c0cae20849a24aa3bdcfb63958a7829f
I20260620 22:03:42.424728 6639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:42.442297 6639 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:42.442715 6639 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:42.444691 6639 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba975e5843b34d92a83375099620a99c: Generated new TSK 0
I20260620 22:03:42.444847 6639 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:03:42.454780 6630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:42.451692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36184 (local address 127.1.55.254:44305)
0620 22:03:42.451729 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:42.451731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:42.451818 (+ 87us) server_negotiation.cc:407] Connection header received
0620 22:03:42.451875 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:42.451876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:42.451883 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:42.451932 (+ 49us) server_negotiation.cc:226] Negotiated authn=JWT
0620 22:03:42.452075 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.452522 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.453554 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.453717 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.453762 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.453928 (+ 166us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0620 22:03:42.454579 (+ 651us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0620 22:03:42.454720 (+ 141us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36184: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":21}
W20260620 22:03:42.454828 6630 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36184: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260620 22:03:42.454854 6656 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:03:42.451611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:44305 (local address 127.0.0.1:36184)
0620 22:03:42.451754 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:42.451763 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:42.451819 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:42.451944 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:42.451945 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:42.451946 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0620 22:03:42.452001 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:42.452003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.452586 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.452586 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:42.453465 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:42.453486 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.453780 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.453781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:42.453843 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.453848 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0620 22:03:42.454690 (+ 842us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0620 22:03:42.454766 (+ 76us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.55.254:44305: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45661/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
I20260620 22:03:42.455016 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 6560
E20260620 22:03:42.466303 6657 webserver.cc:533] Webserver: sslize failed:
E20260620 22:03:42.466353 6657 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-06-20T22:03:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (187 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-06-20T22:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:42Z Disabled control of system clock
I20260620 22:03:42.499197 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42397
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:38841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:42397
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/testchainca.cert with env {}
W20260620 22:03:42.571822 6661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:42.571979 6661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:42.572000 6661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:42.573050 6661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:42.573088 6661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:42.573100 6661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:42.573112 6661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:42.573153 6661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260620 22:03:42.573170 6661 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260620 22:03:42.573190 6661 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260620 22:03:42.574612 6661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:38841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:42397
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:42.574771 6661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:42.574961 6661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:03:42.579330 6661 server_base.cc:1034] running on GCE node
W20260620 22:03:42.579314 6669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:42.579314 6666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:42.579294 6667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:42.579689 6661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:42.579958 6661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:42.581125 6661 hybrid_clock.cc:648] HybridClock initialized: now 1781993022581101 us; error 43 us; skew 500 ppm
I20260620 22:03:42.582259 6661 webserver.cc:460] Webserver started at http://127.1.55.254:44227/ using document root <none> and password file <none>
I20260620 22:03:42.582476 6661 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:42.582537 6661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:42.582674 6661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:42.583580 6661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "1865faf6a41e466c9abc936cebc2e6e1"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "a00821e916244cd6bd4788a82e11c000"
server_key_iv: "789109b4d58a8bc0910e70504cabfc80"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.583897 6661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "1865faf6a41e466c9abc936cebc2e6e1"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "a00821e916244cd6bd4788a82e11c000"
server_key_iv: "789109b4d58a8bc0910e70504cabfc80"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.585012 6661 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:42.585737 6675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:42.585899 6661 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:42.585994 6661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "1865faf6a41e466c9abc936cebc2e6e1"
format_stamp: "Formatted at 2026-06-20 22:03:42 on dist-test-slave-xw35"
server_key: "a00821e916244cd6bd4788a82e11c000"
server_key_iv: "789109b4d58a8bc0910e70504cabfc80"
server_key_version: "encryptionkey@0"
I20260620 22:03:42.586066 6661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:42.602250 6661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:42.602478 6661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:42.602612 6661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:42.606685 6661 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:42397
I20260620 22:03:42.606711 6727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:42397 every 8 connection(s)
I20260620 22:03:42.607057 6661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:42.608043 6728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:42.610514 6728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1: Bootstrap starting.
I20260620 22:03:42.610971 6728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:42.611193 6728 log.cc:824] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:42.611778 6728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1: No bootstrap required, opened a new log
I20260620 22:03:42.613018 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 6661
I20260620 22:03:42.613128 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:42.613322 1247 external_mini_cluster.cc:1428] Setting key 8a220bc33c0e66fc976da282043bea2a
I20260620 22:03:42.613359 6728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1865faf6a41e466c9abc936cebc2e6e1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42397 } }
I20260620 22:03:42.613533 6728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:42.613572 6728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1865faf6a41e466c9abc936cebc2e6e1, State: Initialized, Role: FOLLOWER
I20260620 22:03:42.613690 6728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1865faf6a41e466c9abc936cebc2e6e1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42397 } }
I20260620 22:03:42.613793 6728 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:42.613828 6728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:42.613871 6728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:42.614439 6728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1865faf6a41e466c9abc936cebc2e6e1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42397 } }
I20260620 22:03:42.614542 6728 leader_election.cc:302] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1865faf6a41e466c9abc936cebc2e6e1; no voters:
I20260620 22:03:42.614681 6728 leader_election.cc:288] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:42.614823 6733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:42.614931 6728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:42.614944 6733 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [term 1 LEADER]: Becoming Leader. State: Replica: 1865faf6a41e466c9abc936cebc2e6e1, State: Running, Role: LEADER
I20260620 22:03:42.615017 6733 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1865faf6a41e466c9abc936cebc2e6e1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42397 } }
I20260620 22:03:42.615325 6733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1865faf6a41e466c9abc936cebc2e6e1. Latest consensus state: current_term: 1 leader_uuid: "1865faf6a41e466c9abc936cebc2e6e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1865faf6a41e466c9abc936cebc2e6e1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42397 } } }
I20260620 22:03:42.615402 6733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:42.615338 6734 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1865faf6a41e466c9abc936cebc2e6e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1865faf6a41e466c9abc936cebc2e6e1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42397 } } }
I20260620 22:03:42.615561 6739 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:42.615577 6734 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:42.616024 6739 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:42.617280 6750 mvcc.cc:205] Tried to move back new op lower bound from 7299043420638994432 to 7299043420631568384. Current Snapshot: MvccSnapshot[applied={T|T < 7299043420638994432}]
I20260620 22:03:42.617966 6739 catalog_manager.cc:1347] Generated new cluster ID: 5f6b340cf813420590cdb453b4b1d401
I20260620 22:03:42.618014 6739 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:42.624488 6739 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:42.625018 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:42.613870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44496 (local address 127.1.55.254:42397)
0620 22:03:42.614043 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:42.614050 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:42.614091 (+ 41us) server_negotiation.cc:407] Connection header received
0620 22:03:42.614172 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:42.614176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:42.614225 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:42.614317 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:42.614546 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.615875 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.616984 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.617602 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.617730 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.624250 (+ 6520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:42.624254 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:42.624254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:03:42.624455 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:42.624493 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:03:42.624507 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:42.624612 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:42.624699 (+ 87us) server_negotiation.cc:299] Negotiation successful
0620 22:03:42.624841 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260620 22:03:42.625046 6739 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:42.625929 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:03:42.630170 6739 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1865faf6a41e466c9abc936cebc2e6e1: Generated new TSK 0
I20260620 22:03:42.630359 6739 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:03:42.692195 6732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:42.636170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44502 (local address 127.1.55.254:42397)
0620 22:03:42.636240 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:42.636242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:42.636360 (+ 118us) server_negotiation.cc:407] Connection header received
0620 22:03:42.636420 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:42.636420 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:42.636429 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:42.636473 (+ 44us) server_negotiation.cc:226] Negotiated authn=JWT
0620 22:03:42.636601 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.637074 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.638092 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.638532 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.638583 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.638762 (+ 179us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0620 22:03:42.692022 (+ 53260us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0620 22:03:42.692149 (+ 127us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44502: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":34}
W20260620 22:03:42.692266 6732 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44502: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260620 22:03:42.692373 6757 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:03:42.636118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42397 (local address 127.0.0.1:44502)
0620 22:03:42.636295 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:42.636305 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:42.636363 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:42.636482 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:42.636483 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:42.636485 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0620 22:03:42.636528 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:42.636530 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.637161 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.637162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:42.638017 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:42.638019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:42.638605 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:42.638606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:42.638673 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:42.638679 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0620 22:03:42.692153 (+ 53474us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0620 22:03:42.692281 (+ 128us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.55.254:42397: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":120,"threads_started":1}
I20260620 22:03:42.692620 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 6661
2026-06-20T22:03:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (216 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (78 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (78 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:42 dist-test-slave-xw35 krb5kdc[6769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:42 dist-test-slave-xw35 krb5kdc[6769](info): set up 2 sockets
Jun 20 22:03:42 dist-test-slave-xw35 krb5kdc[6769](info): commencing operation
krb5kdc: starting...
W20260620 22:03:43.821391 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.954s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:03:43 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:03:43.921597 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42673
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:38041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:42673
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:43.995278 6782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:43.995457 6782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:43.995478 6782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:43.996626 6782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:43.996665 6782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:43.996677 6782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:43.996726 6782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:43.996747 6782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:43.998039 6782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:38041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:42673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:43.998250 6782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:43.998450 6782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:44.002820 6790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:44.002832 6788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:44.002831 6787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:44.003095 6782 server_base.cc:1034] running on GCE node
I20260620 22:03:44.003381 6782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:44.003666 6782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:44.004848 6782 hybrid_clock.cc:648] HybridClock initialized: now 1781993024004827 us; error 41 us; skew 500 ppm
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.010690 6782 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:03:44.011149 6782 webserver.cc:460] Webserver started at http://127.1.55.254:46597/ using document root <none> and password file <none>
I20260620 22:03:44.011354 6782 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:44.011418 6782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:44.011562 6782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:44.012497 6782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "da84b3d89afe4ff8ad1ec0e9857312de"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "61912f71dc1dc6a2c9f8e3d5597e5e0d"
server_key_iv: "6a3ac2707755915708c0ddd9288d9b96"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.012835 6782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "da84b3d89afe4ff8ad1ec0e9857312de"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "61912f71dc1dc6a2c9f8e3d5597e5e0d"
server_key_iv: "6a3ac2707755915708c0ddd9288d9b96"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.014066 6782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:03:44.014717 6797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.014865 6782 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:44.014972 6782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "da84b3d89afe4ff8ad1ec0e9857312de"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "61912f71dc1dc6a2c9f8e3d5597e5e0d"
server_key_iv: "6a3ac2707755915708c0ddd9288d9b96"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.015048 6782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:44.022411 6782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:44.024516 6782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:44.024688 6782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:44.028530 6782 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:42673
I20260620 22:03:44.028559 6849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:42673 every 8 connection(s)
I20260620 22:03:44.028914 6782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:44.029695 6850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:44.031672 6850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de: Bootstrap starting.
I20260620 22:03:44.032196 6850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:44.032461 6850 log.cc:824] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:44.033051 6850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de: No bootstrap required, opened a new log
I20260620 22:03:44.034528 6850 raft_consensus.cc:348] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da84b3d89afe4ff8ad1ec0e9857312de" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42673 } }
I20260620 22:03:44.034657 6850 raft_consensus.cc:374] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:44.034678 6850 raft_consensus.cc:729] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da84b3d89afe4ff8ad1ec0e9857312de, State: Initialized, Role: FOLLOWER
I20260620 22:03:44.034864 6850 consensus_queue.cc:260] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da84b3d89afe4ff8ad1ec0e9857312de" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42673 } }
I20260620 22:03:44.034952 6850 raft_consensus.cc:388] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:44.034984 6850 raft_consensus.cc:482] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:44.035027 6850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:44.035025 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 6782
I20260620 22:03:44.035161 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:44.035377 1247 external_mini_cluster.cc:1428] Setting key 4bbb055bf637ec88e3d2c9ff73547427
I20260620 22:03:44.035717 6850 raft_consensus.cc:504] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da84b3d89afe4ff8ad1ec0e9857312de" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42673 } }
I20260620 22:03:44.035863 6850 leader_election.cc:302] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da84b3d89afe4ff8ad1ec0e9857312de; no voters:
I20260620 22:03:44.036008 6850 leader_election.cc:288] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:44.036188 6855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:44.036268 6850 sys_catalog.cc:564] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:44.036303 6855 raft_consensus.cc:686] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [term 1 LEADER]: Becoming Leader. State: Replica: da84b3d89afe4ff8ad1ec0e9857312de, State: Running, Role: LEADER
I20260620 22:03:44.036373 6855 consensus_queue.cc:237] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da84b3d89afe4ff8ad1ec0e9857312de" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42673 } }
I20260620 22:03:44.036796 6857 sys_catalog.cc:455] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [sys.catalog]: SysCatalogTable state changed. Reason: New leader da84b3d89afe4ff8ad1ec0e9857312de. Latest consensus state: current_term: 1 leader_uuid: "da84b3d89afe4ff8ad1ec0e9857312de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da84b3d89afe4ff8ad1ec0e9857312de" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42673 } } }
I20260620 22:03:44.036921 6857 sys_catalog.cc:458] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:44.036779 6856 sys_catalog.cc:455] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da84b3d89afe4ff8ad1ec0e9857312de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da84b3d89afe4ff8ad1ec0e9857312de" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42673 } } }
I20260620 22:03:44.037200 6856 sys_catalog.cc:458] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:44.037111 6864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:44.037741 6864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:44.039165 6864 catalog_manager.cc:1347] Generated new cluster ID: 880bac101378464ebe7b1f4f649891d6
I20260620 22:03:44.039211 6864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:44.047376 6864 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:44.047930 6864 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:44.048548 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.035832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47264 (local address 127.1.55.254:42673)
0620 22:03:44.036033 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.036040 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.037726 (+ 1686us) server_negotiation.cc:407] Connection header received
0620 22:03:44.037878 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.037885 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.037935 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.038090 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.038835 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.040062 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.041053 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.041652 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.041724 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.044318 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:44.044322 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:44.044322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:44.044332 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:44.046801 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.047164 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.047167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.047167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.047275 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.047518 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.047519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.047519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.047815 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:44.047943 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:44.048203 (+ 260us) server_negotiation.cc:299] Negotiation successful
0620 22:03:44.048341 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":106,"threads_started":1}
I20260620 22:03:44.053618 6864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da84b3d89afe4ff8ad1ec0e9857312de: Generated new TSK 0
I20260620 22:03:44.053777 6864 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:03:44.080159 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42673
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:38041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:44.152264 6876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:44.152462 6876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:44.152494 6876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:44.153627 6876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:44.153692 6876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:44.153728 6876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:44.155027 6876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:38041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:44.155277 6876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:44.155490 6876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:03:44.160006 6876 server_base.cc:1034] running on GCE node
W20260620 22:03:44.159976 6882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:44.159981 6881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:44.159960 6884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:44.160363 6876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:44.160539 6876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:44.161696 6876 hybrid_clock.cc:648] HybridClock initialized: now 1781993024161684 us; error 45 us; skew 500 ppm
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.163851 6876 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:03:44.164212 6876 webserver.cc:460] Webserver started at http://127.1.55.193:40463/ using document root <none> and password file <none>
I20260620 22:03:44.164354 6876 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:44.164386 6876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:44.164458 6876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:44.165328 6876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "e5b9472b499548a29f646b25ffb68274"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "92ae32dbba9292d189cae882cdc98a03"
server_key_iv: "1114dead02e62631e8e3069d402d1ed1"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.165675 6876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "e5b9472b499548a29f646b25ffb68274"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "92ae32dbba9292d189cae882cdc98a03"
server_key_iv: "1114dead02e62631e8e3069d402d1ed1"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.166879 6876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:44.167502 6891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.167675 6876 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:44.167749 6876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "e5b9472b499548a29f646b25ffb68274"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "92ae32dbba9292d189cae882cdc98a03"
server_key_iv: "1114dead02e62631e8e3069d402d1ed1"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.167798 6876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:44.182155 6876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:44.183630 6876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:44.183722 6876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:44.183861 6876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:44.184121 6876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:44.184170 6876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.184209 6876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:44.184235 6876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.189267 6876 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:36971
I20260620 22:03:44.189320 7004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:36971 every 8 connection(s)
I20260620 22:03:44.189622 6876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:44.194101 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 6876
I20260620 22:03:44.194197 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:44.194346 1247 external_mini_cluster.cc:1428] Setting key b88418f190b8b8fba3e0c2a8e7e3a029
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:44.198297 7007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.190252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42673 (local address 127.1.55.193:41805)
0620 22:03:44.190404 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:44.190432 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:44.191201 (+ 769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:44.191429 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:44.191432 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:44.191642 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:44.191787 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:44.191790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.192428 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.192429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:44.193143 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:44.193144 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.193524 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.193525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:44.193634 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.194086 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:44.194093 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:44.195381 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:44.197146 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:44.197151 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:44.197153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:44.197355 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:44.197553 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:44.197554 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:44.197554 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:44.197656 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:44.197907 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:44.197911 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:44.198004 (+ 93us) client_negotiation.cc:769] Sending connection context
0620 22:03:44.198074 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 22:03:44.198172 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260620 22:03:44.198324 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.190259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:41805 (local address 127.1.55.254:42673)
0620 22:03:44.190321 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.190323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.190503 (+ 180us) server_negotiation.cc:407] Connection header received
0620 22:03:44.191301 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.191302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.191314 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.191361 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.191872 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.192340 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.193237 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.193433 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.193519 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.195474 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:44.195475 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:44.195476 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:44.195483 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:44.197057 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.197419 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.197420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.197421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.197499 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.197716 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.197717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.197718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.197849 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:44.197913 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:44.198117 (+ 204us) server_negotiation.cc:299] Negotiation successful
0620 22:03:44.198200 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260620 22:03:44.198758 7005 heartbeater.cc:347] Connected to a master server at 127.1.55.254:42673
I20260620 22:03:44.198863 7005 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:44.199008 7005 heartbeater.cc:511] Master 127.1.55.254:42673 requested a full tablet report, sending...
I20260620 22:03:44.199489 6814 ts_manager.cc:194] Registered new tserver with Master: e5b9472b499548a29f646b25ffb68274 (127.1.55.193:36971)
I20260620 22:03:44.200398 6814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:41805
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:03:44.216706 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42673
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:38041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:44.289446 7010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:44.289613 7010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:44.289633 7010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:44.290534 7010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:44.290562 7010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:44.290583 7010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:44.291733 7010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:38041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:44.291918 7010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:44.292057 7010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:44.296239 7015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:44.296375 7010 server_base.cc:1034] running on GCE node
W20260620 22:03:44.296465 7018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:44.296252 7016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:44.296672 7010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:44.296888 7010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:44.298012 7010 hybrid_clock.cc:648] HybridClock initialized: now 1781993024298005 us; error 29 us; skew 500 ppm
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.300096 7010 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:03:44.300508 7010 webserver.cc:460] Webserver started at http://127.1.55.194:33703/ using document root <none> and password file <none>
I20260620 22:03:44.300697 7010 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:44.300756 7010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:44.300871 7010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:44.301779 7010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "e81a5c8fed1243b0ac95a5058b696a5f"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "9b2c27fcae0fcedcaf1c4eaea3131fa3"
server_key_iv: "4bdd442d7029c550bce5f2727581bced"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.302107 7010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "e81a5c8fed1243b0ac95a5058b696a5f"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "9b2c27fcae0fcedcaf1c4eaea3131fa3"
server_key_iv: "4bdd442d7029c550bce5f2727581bced"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.303239 7010 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:44.303853 7025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.304009 7010 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:44.304104 7010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "e81a5c8fed1243b0ac95a5058b696a5f"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "9b2c27fcae0fcedcaf1c4eaea3131fa3"
server_key_iv: "4bdd442d7029c550bce5f2727581bced"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.304178 7010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:44.315572 7010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:44.317277 7010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:44.317422 7010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:44.317656 7010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:44.317910 7010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:44.317960 7010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.317986 7010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:44.318014 7010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.323870 7010 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:43039
I20260620 22:03:44.323917 7138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:43039 every 8 connection(s)
I20260620 22:03:44.324173 7010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:44.330372 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 7010
I20260620 22:03:44.330474 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:44.330643 1247 external_mini_cluster.cc:1428] Setting key b1060dd68425e4f68536648489393589
I20260620 22:03:44.332823 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.324768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:40085 (local address 127.1.55.254:42673)
0620 22:03:44.324845 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.324847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.325003 (+ 156us) server_negotiation.cc:407] Connection header received
0620 22:03:44.325906 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.325907 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.325915 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.325974 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.326535 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.327000 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.327920 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.328096 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.328144 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.330109 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:44.330111 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:44.330111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:44.330117 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:44.331640 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.331973 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.331974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.331974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.332035 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.332244 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.332245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.332245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.332377 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:44.332441 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:44.332654 (+ 213us) server_negotiation.cc:299] Negotiation successful
0620 22:03:44.332739 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260620 22:03:44.332957 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.324709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42673 (local address 127.1.55.194:40085)
0620 22:03:44.324888 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:44.324924 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:44.325821 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:44.326024 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:44.326027 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:44.326275 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:44.326469 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:44.326473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.327068 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.327069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:44.327845 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:44.327847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.328163 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.328163 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:44.328250 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.328761 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:44.328775 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:44.330035 (+ 1260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:44.331719 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:44.331724 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:44.331725 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:44.331909 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:44.332096 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:44.332096 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:44.332097 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:44.332178 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:44.332434 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:44.332437 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:44.332527 (+ 90us) client_negotiation.cc:769] Sending connection context
0620 22:03:44.332631 (+ 104us) client_negotiation.cc:240] Negotiation successful
0620 22:03:44.332759 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":100,"threads_started":1}
I20260620 22:03:44.333423 7139 heartbeater.cc:347] Connected to a master server at 127.1.55.254:42673
I20260620 22:03:44.333560 7139 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:44.333720 7139 heartbeater.cc:511] Master 127.1.55.254:42673 requested a full tablet report, sending...
I20260620 22:03:44.334064 6814 ts_manager.cc:194] Registered new tserver with Master: e81a5c8fed1243b0ac95a5058b696a5f (127.1.55.194:43039)
I20260620 22:03:44.334407 6814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:40085
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:03:44.352959 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42673
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:38041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:44.426764 7144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:44.426921 7144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:44.426940 7144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:44.427953 7144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:44.427986 7144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:44.428010 7144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:44.429298 7144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:38041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:44.429441 7144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:44.429651 7144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:44.434058 7152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:44.434047 7149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:44.434099 7144 server_base.cc:1034] running on GCE node
W20260620 22:03:44.434034 7150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:44.434419 7144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:44.434624 7144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:44.435750 7144 hybrid_clock.cc:648] HybridClock initialized: now 1781993024435739 us; error 26 us; skew 500 ppm
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.438274 7144 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:03:44.438598 7144 webserver.cc:460] Webserver started at http://127.1.55.195:42803/ using document root <none> and password file <none>
I20260620 22:03:44.438766 7144 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:44.438802 7144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:44.438877 7144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:44.439725 7144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "c516e0ae05d241c9897443479a9a639c"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "b32f13a42094e06d5cc26018a744bf8a"
server_key_iv: "07ba8aba9cf99da3e33e0d88b2cc912f"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.439989 7144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "c516e0ae05d241c9897443479a9a639c"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "b32f13a42094e06d5cc26018a744bf8a"
server_key_iv: "07ba8aba9cf99da3e33e0d88b2cc912f"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.441164 7144 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:03:44.441830 7159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.441964 7144 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.442034 7144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "c516e0ae05d241c9897443479a9a639c"
format_stamp: "Formatted at 2026-06-20 22:03:44 on dist-test-slave-xw35"
server_key: "b32f13a42094e06d5cc26018a744bf8a"
server_key_iv: "07ba8aba9cf99da3e33e0d88b2cc912f"
server_key_version: "encryptionkey@0"
I20260620 22:03:44.442080 7144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:44.452855 7144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:44.454953 7144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:44.455067 7144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:44.455224 7144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:44.455431 7144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:44.455459 7144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.455478 7144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:44.455490 7144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:44.460634 7144 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:33769
I20260620 22:03:44.460709 7272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:33769 every 8 connection(s)
I20260620 22:03:44.460974 7144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:03:44.466650 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 7144
I20260620 22:03:44.466754 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:44.466936 1247 external_mini_cluster.cc:1428] Setting key 9905398e0abeca4776e84a328d6e95a0
I20260620 22:03:44.469537 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.461693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:48291 (local address 127.1.55.254:42673)
0620 22:03:44.461739 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.461741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.461927 (+ 186us) server_negotiation.cc:407] Connection header received
0620 22:03:44.462788 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.462789 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.462801 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.462848 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.463372 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.463836 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.464731 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.464923 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.465000 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.466901 (+ 1901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:44.466903 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:44.466903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:44.466910 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:44.468284 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.468662 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.468675 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.468675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.468722 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.468946 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.468947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.468947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.469063 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:44.469132 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:44.469361 (+ 229us) server_negotiation.cc:299] Negotiation successful
0620 22:03:44.469428 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:03:44.469676 7275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.461659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42673 (local address 127.1.55.195:48291)
0620 22:03:44.461790 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:44.461832 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:44.462686 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:44.462914 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:44.462918 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:44.463131 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:44.463279 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:44.463283 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.463932 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.463933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:44.464641 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:44.464643 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.465007 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.465008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:44.465122 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.465501 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:44.465509 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:44.466814 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:44.468373 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:44.468379 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:44.468381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:44.468592 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:44.468792 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:44.468793 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:44.468794 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:44.468887 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:44.469125 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:44.469130 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:44.469248 (+ 118us) client_negotiation.cc:769] Sending connection context
0620 22:03:44.469343 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 22:03:44.469470 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260620 22:03:44.470078 7273 heartbeater.cc:347] Connected to a master server at 127.1.55.254:42673
I20260620 22:03:44.470139 7273 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:44.470348 7273 heartbeater.cc:511] Master 127.1.55.254:42673 requested a full tablet report, sending...
I20260620 22:03:44.470682 6814 ts_manager.cc:194] Registered new tserver with Master: c516e0ae05d241c9897443479a9a639c (127.1.55.195:33769)
I20260620 22:03:44.470975 6814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:48291
I20260620 22:03:44.478569 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/test-admin.keytab.
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.492364 1247 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260620 22:03:44.493672 7280 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:03:44.493017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33486 (local address 127.1.55.193:36971)
0620 22:03:44.493158 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.493166 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.493175 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:44.493197 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.493198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.493210 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.493268 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.493597 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33486: BlockingRecv error: recv got EOF from 127.0.0.1:33486 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
W20260620 22:03:44.493791 1247 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5cc' of type FILE
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.494665 1247 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.495474 1247 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:44.502777 7280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.495956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33494 (local address 127.1.55.193:36971)
0620 22:03:44.496022 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.496024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.496033 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:44.496119 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.496120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.496129 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.496200 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.496582 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.497254 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.498020 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.498312 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.498399 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.500186 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:44.500193 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:44.500193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:44.500199 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:44.501678 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.502024 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.502026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.502027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.502084 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.502276 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.502276 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.502277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.502402 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:44.502529 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:44.502614 (+ 85us) server_negotiation.cc:299] Negotiation successful
0620 22:03:44.502686 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260620 22:03:44.504139 7280 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:03:44.503733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33506 (local address 127.1.55.193:36971)
0620 22:03:44.503764 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.503765 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.503792 (+ 27us) server_negotiation.cc:407] Connection header received
0620 22:03:44.503845 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.503846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.503852 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.503886 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.504106 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33506: BlockingRecv error: recv got EOF from 127.0.0.1:33506 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260620 22:03:44.504204 1247 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5cc' of type FILE
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.504967 1247 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.505764 1247 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:44.512112 7280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.506214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33512 (local address 127.1.55.193:36971)
0620 22:03:44.506268 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.506270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.506335 (+ 65us) server_negotiation.cc:407] Connection header received
0620 22:03:44.506405 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.506406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.506416 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.506496 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.506864 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.507286 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.508049 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.508248 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.508328 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.510066 (+ 1738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:44.510067 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:44.510068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:44.510080 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:44.511163 (+ 1083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.511467 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.511468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.511468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.511517 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.511697 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.511698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.511699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.511779 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:44.511867 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:44.511962 (+ 95us) server_negotiation.cc:299] Negotiation successful
0620 22:03:44.512025 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260620 22:03:44.513144 7280 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:03:44.512781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33520 (local address 127.1.55.193:36971)
0620 22:03:44.512810 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.512812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.512845 (+ 33us) server_negotiation.cc:407] Connection header received
0620 22:03:44.512885 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.512886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.512891 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.512930 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.513121 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33520: BlockingRecv error: recv got EOF from 127.0.0.1:33520 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260620 22:03:44.513302 1247 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781993001979103-1247-0/krb5kdc/krb5cc' of type FILE
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.514158 1247 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:44.514961 1247 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[6769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:03:44.521004 7280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:44.515422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33526 (local address 127.1.55.193:36971)
0620 22:03:44.515473 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:44.515475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:44.515535 (+ 60us) server_negotiation.cc:407] Connection header received
0620 22:03:44.515569 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:44.515569 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:44.515577 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:44.515622 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:44.515927 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.516345 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.516983 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:44.517188 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:44.517277 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:44.519128 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:44.519129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:44.519129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:44.519135 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:44.520165 (+ 1030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.520486 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.520486 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.520486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.520529 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:44.520685 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:44.520685 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:44.520685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:44.520757 (+ 72us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:44.520816 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:44.520910 (+ 94us) server_negotiation.cc:299] Negotiation successful
0620 22:03:44.520957 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 22:03:44.521596 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 6876
I20260620 22:03:44.526504 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 7010
I20260620 22:03:44.530328 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 7144
I20260620 22:03:44.534137 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 6782
2026-06-20T22:03:44Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1685 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[7293](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[7293](info): set up 2 sockets
Jun 20 22:03:44 dist-test-slave-xw35 krb5kdc[7293](info): commencing operation
krb5kdc: starting...
W20260620 22:03:45.513336 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.960s user 0.000s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260620 22:03:45.728041 1247 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.195s user 0.000s sys 0.001s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260620 22:03:45.910393 1247 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.182s user 0.000s sys 0.001s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/test-user.keytab.
W20260620 22:03:46.557391 1247 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.647s user 0.000s sys 0.001s
Jun 20 22:03:46 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:03:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:03:46Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.254.keytab.
Entry for principal oryx/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.254.keytab.
W20260620 22:03:47.629271 1247 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.1.55.254: real 1.051s user 0.000s sys 0.002s
I20260620 22:03:47.629724 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38079
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.254.keytab
--principal=oryx/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:47.709106 7306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:47.709293 7306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:47.709313 7306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:47.710353 7306 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:47.710388 7306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:47.710402 7306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:47.710414 7306 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:47.710425 7306 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:47.711766 7306 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.254.keytab
--principal=oryx/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:47.711936 7306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:47.712100 7306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:47.716605 7312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:47.716658 7306 server_base.cc:1034] running on GCE node
W20260620 22:03:47.716617 7314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:47.716606 7311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:47.717094 7306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:47.717383 7306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:47.718556 7306 hybrid_clock.cc:648] HybridClock initialized: now 1781993027718534 us; error 34 us; skew 500 ppm
Jun 20 22:03:47 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993027, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:47.720914 7306 init.cc:377] Logged in from keytab as oryx/127.1.55.254@KRBTEST.COM (short username oryx)
I20260620 22:03:47.721318 7306 webserver.cc:460] Webserver started at http://127.1.55.254:36027/ using document root <none> and password file <none>
I20260620 22:03:47.721606 7306 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:47.721699 7306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:47.721853 7306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:47.722790 7306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "488004efac5449d89be8c0f12a26ca72"
format_stamp: "Formatted at 2026-06-20 22:03:47 on dist-test-slave-xw35"
server_key: "b3d24202e76a643406eaf99218f72cd6"
server_key_iv: "713894dc223ffec19315e2a7adcce243"
server_key_version: "encryptionkey@0"
I20260620 22:03:47.723145 7306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "488004efac5449d89be8c0f12a26ca72"
format_stamp: "Formatted at 2026-06-20 22:03:47 on dist-test-slave-xw35"
server_key: "b3d24202e76a643406eaf99218f72cd6"
server_key_iv: "713894dc223ffec19315e2a7adcce243"
server_key_version: "encryptionkey@0"
I20260620 22:03:47.724458 7306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:47.725167 7321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:47.725575 7306 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:03:47.725679 7306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "488004efac5449d89be8c0f12a26ca72"
format_stamp: "Formatted at 2026-06-20 22:03:47 on dist-test-slave-xw35"
server_key: "b3d24202e76a643406eaf99218f72cd6"
server_key_iv: "713894dc223ffec19315e2a7adcce243"
server_key_version: "encryptionkey@0"
I20260620 22:03:47.725762 7306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:47.757655 7306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:47.759972 7306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:47.760143 7306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:47.763993 7306 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:38079
I20260620 22:03:47.764040 7373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:38079 every 8 connection(s)
I20260620 22:03:47.764417 7306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:03:47.765389 7374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:47.767609 7374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: Bootstrap starting.
I20260620 22:03:47.768179 7374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:47.768460 7374 log.cc:824] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:47.769138 7374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: No bootstrap required, opened a new log
I20260620 22:03:47.770689 7374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } }
I20260620 22:03:47.770817 7374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:47.770840 7374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 488004efac5449d89be8c0f12a26ca72, State: Initialized, Role: FOLLOWER
I20260620 22:03:47.771016 7374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } }
I20260620 22:03:47.771080 7374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:03:47.771133 7374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:03:47.771183 7374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:47.774396 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 7306
I20260620 22:03:47.774509 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:03:47.774672 1247 external_mini_cluster.cc:1428] Setting key 99f86828cd404e1e2cc0d3b832dd06fc
Jun 20 22:03:47 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:03:47.783228 7378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:47.775075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47198 (local address 127.1.55.254:38079)
0620 22:03:47.775221 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:47.775230 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:47.775261 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:03:47.775339 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:47.775344 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:47.775379 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:47.775524 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:47.776162 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:47.776989 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:47.777800 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:47.778176 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:47.778314 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:47.780406 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:47.780410 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:47.780411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:47.780421 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:47.781827 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:47.782170 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:47.782173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:47.782173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:47.782249 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:47.782459 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:47.782460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:47.782460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:47.782693 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:47.782838 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:47.782944 (+ 106us) server_negotiation.cc:299] Negotiation successful
0620 22:03:47.783069 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":68,"threads_started":1}
I20260620 22:03:47.819418 7374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } }
I20260620 22:03:47.819589 7374 leader_election.cc:302] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 488004efac5449d89be8c0f12a26ca72; no voters:
I20260620 22:03:47.819813 7374 leader_election.cc:288] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:03:47.819908 7379 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:47.820066 7379 raft_consensus.cc:686] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 1 LEADER]: Becoming Leader. State: Replica: 488004efac5449d89be8c0f12a26ca72, State: Running, Role: LEADER
I20260620 22:03:47.820112 7374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:47.820253 7379 consensus_queue.cc:237] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } }
I20260620 22:03:47.820859 7381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 488004efac5449d89be8c0f12a26ca72. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } }
I20260620 22:03:47.820950 7381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:47.821115 7380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } }
I20260620 22:03:47.821192 7380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:47.821455 7388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:03:47.821982 7388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:03:47.824334 7388 catalog_manager.cc:1347] Generated new cluster ID: ebe1a99a91e34386a6b35130d40ae2d4
I20260620 22:03:47.824419 7388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:03:47.844403 7388 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:03:47.844897 7388 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:03:47.848362 7388 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: Generated new TSK 0
I20260620 22:03:47.848553 7388 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab.
Entry for principal oryx/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab.
W20260620 22:03:48.749573 1247 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.1.55.193: real 0.890s user 0.003s sys 0.000s
I20260620 22:03:48.749924 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38079
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab
--principal=oryx/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:48.832499 7400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:48.832700 7400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:48.832731 7400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:48.833829 7400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:48.833904 7400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:48.833946 7400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:48.835606 7400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab
--principal=oryx/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:48.835894 7400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:48.836107 7400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:48.840696 7408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:48.840814 7406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:48.840878 7400 server_base.cc:1034] running on GCE node
W20260620 22:03:48.840828 7405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:48.841188 7400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:48.841423 7400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:48.842607 7400 hybrid_clock.cc:648] HybridClock initialized: now 1781993028842582 us; error 41 us; skew 500 ppm
Jun 20 22:03:48 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993028, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:48.844859 7400 init.cc:377] Logged in from keytab as oryx/127.1.55.193@KRBTEST.COM (short username oryx)
I20260620 22:03:48.845263 7400 webserver.cc:460] Webserver started at http://127.1.55.193:36519/ using document root <none> and password file <none>
I20260620 22:03:48.845544 7400 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:48.845624 7400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:48.845777 7400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:48.846724 7400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "7637e08ae62f424080b476557b0e31b3"
format_stamp: "Formatted at 2026-06-20 22:03:48 on dist-test-slave-xw35"
server_key: "d295b6a16dd6006ebd04e491c546534d"
server_key_iv: "fff31744fb0686239414d14168b6368c"
server_key_version: "encryptionkey@0"
I20260620 22:03:48.847075 7400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "7637e08ae62f424080b476557b0e31b3"
format_stamp: "Formatted at 2026-06-20 22:03:48 on dist-test-slave-xw35"
server_key: "d295b6a16dd6006ebd04e491c546534d"
server_key_iv: "fff31744fb0686239414d14168b6368c"
server_key_version: "encryptionkey@0"
I20260620 22:03:48.848353 7400 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:48.849047 7415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:48.849215 7400 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:48.849313 7400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "7637e08ae62f424080b476557b0e31b3"
format_stamp: "Formatted at 2026-06-20 22:03:48 on dist-test-slave-xw35"
server_key: "d295b6a16dd6006ebd04e491c546534d"
server_key_iv: "fff31744fb0686239414d14168b6368c"
server_key_version: "encryptionkey@0"
I20260620 22:03:48.849399 7400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:48.864723 7400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:48.866415 7400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:48.866569 7400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:48.866784 7400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:48.867058 7400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:48.867116 7400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:48.867154 7400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:48.867182 7400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:48.872591 7400 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:39339
I20260620 22:03:48.872622 7528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:39339 every 8 connection(s)
I20260620 22:03:48.872898 7400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:48.874915 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 7400
I20260620 22:03:48.875039 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:03:48.875240 1247 external_mini_cluster.cc:1428] Setting key f8bf9c8b47fc2a44972ecebbef6c7967
Jun 20 22:03:48 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993028, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:03:48.883412 7532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:48.873671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:41835)
0620 22:03:48.873835 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:48.873875 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:48.874310 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:48.875343 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:48.875347 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:48.875881 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:48.876053 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:48.876058 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:48.876854 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:48.876855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:48.877690 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:48.877692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:48.878104 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:48.878105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:48.878237 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:48.878686 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:48.878695 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:48.880262 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:48.882157 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:48.882162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:48.882163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:48.882345 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:48.882564 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:48.882564 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:48.882565 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:48.882646 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:48.882944 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:48.882948 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:48.883094 (+ 146us) client_negotiation.cc:769] Sending connection context
0620 22:03:48.883174 (+ 80us) client_negotiation.cc:240] Negotiation successful
0620 22:03:48.883277 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
I20260620 22:03:48.883448 7531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:48.873680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:41835 (local address 127.1.55.254:38079)
0620 22:03:48.873826 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:48.873836 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:48.873969 (+ 133us) server_negotiation.cc:407] Connection header received
0620 22:03:48.874424 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:48.874426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:48.874470 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:48.874556 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:48.876177 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:48.876742 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:48.877782 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:48.877979 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:48.878097 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:48.880356 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:48.880357 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:48.880357 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:48.880365 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:48.882086 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:48.882421 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:48.882422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:48.882423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:48.882496 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:48.882712 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:48.882714 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:48.882714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:48.882869 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:48.882949 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:48.883230 (+ 281us) server_negotiation.cc:299] Negotiation successful
0620 22:03:48.883315 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":57,"threads_started":1}
I20260620 22:03:48.884064 7529 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38079
I20260620 22:03:48.884163 7529 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.1.55.194@KRBTEST.COM; defaulting to no policy
I20260620 22:03:48.884335 7529 heartbeater.cc:511] Master 127.1.55.254:38079 requested a full tablet report, sending...
I20260620 22:03:48.884850 7338 ts_manager.cc:194] Registered new tserver with Master: 7637e08ae62f424080b476557b0e31b3 (127.1.55.193:39339)
I20260620 22:03:48.885403 7338 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:41835
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab.
Entry for principal oryx/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab.
W20260620 22:03:49.843894 1247 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.1.55.194: real 0.968s user 0.001s sys 0.002s
I20260620 22:03:49.844281 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38079
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab
--principal=oryx/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:03:49.886241 7529 heartbeater.cc:503] Master 127.1.55.254:38079 was elected leader, sending a full tablet report...
W20260620 22:03:49.919544 7535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:49.919759 7535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:49.919793 7535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:49.920979 7535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:49.921041 7535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:49.921082 7535 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:49.922609 7535 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab
--principal=oryx/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7535
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:49.922842 7535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:49.923039 7535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:49.927637 7540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:49.927630 7541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:49.927630 7543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:49.927680 7535 server_base.cc:1034] running on GCE node
I20260620 22:03:49.928016 7535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:49.928277 7535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:49.929411 7535 hybrid_clock.cc:648] HybridClock initialized: now 1781993029929389 us; error 39 us; skew 500 ppm
Jun 20 22:03:49 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993029, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:49.935163 7535 init.cc:377] Logged in from keytab as oryx/127.1.55.194@KRBTEST.COM (short username oryx)
I20260620 22:03:49.935550 7535 webserver.cc:460] Webserver started at http://127.1.55.194:40215/ using document root <none> and password file <none>
I20260620 22:03:49.935712 7535 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:49.935766 7535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:49.935863 7535 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:49.936728 7535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "86c7aa64a4424ce1bcfe31ee449b1913"
format_stamp: "Formatted at 2026-06-20 22:03:49 on dist-test-slave-xw35"
server_key: "8631f8f5aee9d3e79262d35172de12e0"
server_key_iv: "9dfbe2254ec7a98dc707cc6faab37df1"
server_key_version: "encryptionkey@0"
I20260620 22:03:49.937013 7535 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "86c7aa64a4424ce1bcfe31ee449b1913"
format_stamp: "Formatted at 2026-06-20 22:03:49 on dist-test-slave-xw35"
server_key: "8631f8f5aee9d3e79262d35172de12e0"
server_key_iv: "9dfbe2254ec7a98dc707cc6faab37df1"
server_key_version: "encryptionkey@0"
I20260620 22:03:49.938169 7535 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:03:49.938813 7550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:49.938975 7535 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:03:49.939069 7535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "86c7aa64a4424ce1bcfe31ee449b1913"
format_stamp: "Formatted at 2026-06-20 22:03:49 on dist-test-slave-xw35"
server_key: "8631f8f5aee9d3e79262d35172de12e0"
server_key_iv: "9dfbe2254ec7a98dc707cc6faab37df1"
server_key_version: "encryptionkey@0"
I20260620 22:03:49.939157 7535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:49.951820 7535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:49.953804 7535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:49.953953 7535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:49.954166 7535 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:49.954447 7535 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:49.954499 7535 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:49.954535 7535 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:49.954559 7535 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:49.959923 7535 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:42373
I20260620 22:03:49.959959 7663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:42373 every 8 connection(s)
I20260620 22:03:49.960240 7535 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:03:49 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993029, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:03:49.968305 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:49.960914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:55165 (local address 127.1.55.254:38079)
0620 22:03:49.961029 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:49.961031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:49.961101 (+ 70us) server_negotiation.cc:407] Connection header received
0620 22:03:49.961498 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:49.961500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:49.961509 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:49.961559 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:49.962293 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:49.962785 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:49.963652 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:49.963843 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:49.963892 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:49.965735 (+ 1843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:49.965736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:49.965737 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:49.965761 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:49.967222 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:49.967562 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:49.967563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:49.967563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:49.967622 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:49.967824 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:49.967824 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:49.967824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:49.967919 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:49.967969 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:49.968180 (+ 211us) server_negotiation.cc:299] Negotiation successful
0620 22:03:49.968241 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":70,"threads_started":1}
I20260620 22:03:49.968411 7666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:49.960858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:55165)
0620 22:03:49.960994 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:49.961028 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:49.961409 (+ 381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:49.961602 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:49.961605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:49.962060 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:49.962223 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:49.962227 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:49.962860 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:49.962861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:49.963572 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:49.963573 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:49.963912 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:49.963913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:49.963998 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:49.964375 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:49.964381 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:49.965647 (+ 1266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:49.967287 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:49.967291 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:49.967292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:49.967477 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:49.967681 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:49.967682 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:49.967682 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:49.967769 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:49.967975 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:49.967979 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:49.968070 (+ 91us) client_negotiation.cc:769] Sending connection context
0620 22:03:49.968151 (+ 81us) client_negotiation.cc:240] Negotiation successful
0620 22:03:49.968250 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":79,"threads_started":1}
I20260620 22:03:49.968816 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 7535
I20260620 22:03:49.968940 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:03:49.969069 7664 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38079
I20260620 22:03:49.969148 1247 external_mini_cluster.cc:1428] Setting key ac1bd2df84c3f9cdb848f97b58f438ca
I20260620 22:03:49.969183 7664 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:49.969339 7664 heartbeater.cc:511] Master 127.1.55.254:38079 requested a full tablet report, sending...
I20260620 22:03:49.969722 7337 ts_manager.cc:194] Registered new tserver with Master: 86c7aa64a4424ce1bcfe31ee449b1913 (127.1.55.194:42373)
I20260620 22:03:49.970186 7337 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:55165
WARNING: no policy specified for oryx/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab.
Entry for principal oryx/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab.
I20260620 22:03:49.992226 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38079
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab
--principal=oryx/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:50.067178 7670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:50.067338 7670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:50.067358 7670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:50.068431 7670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:50.068467 7670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:50.068492 7670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:50.069797 7670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab
--principal=oryx/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:50.069947 7670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:50.070086 7670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:50.074715 7678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.074715 7675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.074729 7670 server_base.cc:1034] running on GCE node
W20260620 22:03:50.074700 7676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.075045 7670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:50.075266 7670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:50.076398 7670 hybrid_clock.cc:648] HybridClock initialized: now 1781993030076389 us; error 25 us; skew 500 ppm
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:50.078752 7670 init.cc:377] Logged in from keytab as oryx/127.1.55.195@KRBTEST.COM (short username oryx)
I20260620 22:03:50.079282 7670 webserver.cc:460] Webserver started at http://127.1.55.195:32929/ using document root <none> and password file <none>
I20260620 22:03:50.079524 7670 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.079569 7670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.079741 7670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:50.080703 7670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "8dcff8158d384fa0a91d3645dd5fd61c"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "a1000155a97e3cbf64722cf66b4efb9e"
server_key_iv: "7569ac06dda8a72cb43f6bf34e6f2ec8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.081041 7670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "8dcff8158d384fa0a91d3645dd5fd61c"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "a1000155a97e3cbf64722cf66b4efb9e"
server_key_iv: "7569ac06dda8a72cb43f6bf34e6f2ec8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.082360 7670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:03:50.083019 7685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.083196 7670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:03:50.083297 7670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "8dcff8158d384fa0a91d3645dd5fd61c"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "a1000155a97e3cbf64722cf66b4efb9e"
server_key_iv: "7569ac06dda8a72cb43f6bf34e6f2ec8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.083374 7670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.094637 7670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:50.096805 7670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:50.096982 7670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:50.097177 7670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:50.097425 7670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:50.097522 7670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.097579 7670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:50.097604 7670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.102756 7670 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:37265
I20260620 22:03:50.102795 7798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:37265 every 8 connection(s)
I20260620 22:03:50.103076 7670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:03:50.106421 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 7670
I20260620 22:03:50.106541 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:03:50.106707 1247 external_mini_cluster.cc:1428] Setting key 8b2a2b7f835416954e5806dc4164d1b4
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:03:50.111047 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.103673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:35549 (local address 127.1.55.254:38079)
0620 22:03:50.103718 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.103720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.103893 (+ 173us) server_negotiation.cc:407] Connection header received
0620 22:03:50.104285 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.104287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.104295 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.104344 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.105075 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.105592 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.106509 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.106841 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.106909 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.108970 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.108971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.108972 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.108978 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.110087 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.110399 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.110400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.110400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.110442 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.110603 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.110603 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.110604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.110690 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.110734 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.110926 (+ 192us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.110990 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:03:50.111176 7801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.103629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:35549)
0620 22:03:50.103766 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.103800 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.104206 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.104386 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.104389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.104850 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.105004 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.105008 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.105663 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.105664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.106419 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.106420 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.106927 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.106928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.107071 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.107593 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.107602 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.108901 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.110155 (+ 1254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.110160 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.110161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.110340 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.110479 (+ 139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.110479 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.110479 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.110551 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.110742 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.110746 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.110832 (+ 86us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.110902 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.111002 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
I20260620 22:03:50.111685 7799 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38079
I20260620 22:03:50.111754 7799 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:50.111932 7799 heartbeater.cc:511] Master 127.1.55.254:38079 requested a full tablet report, sending...
I20260620 22:03:50.112277 7337 ts_manager.cc:194] Registered new tserver with Master: 8dcff8158d384fa0a91d3645dd5fd61c (127.1.55.195:37265)
I20260620 22:03:50.112639 7337 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:35549
I20260620 22:03:50.118458 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.55.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.253.keytab.
Entry for principal oryx/127.1.55.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.253.keytab.
I20260620 22:03:50.140470 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.253:44805
--webserver_interface=127.1.55.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.253.keytab
--principal=oryx/127.1.55.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38079,127.1.55.253:44805
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:50.213887 7804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:50.214046 7804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:50.214064 7804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:50.215065 7804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:50.215102 7804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:50.215114 7804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:50.215126 7804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:50.215179 7804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:50.216522 7804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38079,127.1.55.253:44805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.253.keytab
--principal=oryx/127.1.55.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.253:44805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.55.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
W20260620 22:03:50.216656 7804 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.1.55.254:38079,127.1.55.253:44805'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260620 22:03:50.216789 7804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:50.217032 7804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:50.221374 7812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.221495 7810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.221495 7809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.221596 7804 server_base.cc:1034] running on GCE node
I20260620 22:03:50.221828 7804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:50.222124 7804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:50.223258 7804 hybrid_clock.cc:648] HybridClock initialized: now 1781993030223258 us; error 36 us; skew 500 ppm
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:50.225704 7804 init.cc:377] Logged in from keytab as oryx/127.1.55.253@KRBTEST.COM (short username oryx)
I20260620 22:03:50.226109 7804 webserver.cc:460] Webserver started at http://127.1.55.253:41665/ using document root <none> and password file <none>
I20260620 22:03:50.226332 7804 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.226375 7804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.226513 7804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:50.227504 7804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data/instance:
uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "2f86f0b42fe6dde4b791effd6a233f06"
server_key_iv: "c02bf2a7655a26a9b04915d03ce59da8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.227855 7804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal/instance:
uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "2f86f0b42fe6dde4b791effd6a233f06"
server_key_iv: "c02bf2a7655a26a9b04915d03ce59da8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.229240 7804 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:03:50.229964 7819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.230142 7804 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.230238 7804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "2f86f0b42fe6dde4b791effd6a233f06"
server_key_iv: "c02bf2a7655a26a9b04915d03ce59da8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.230314 7804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.248347 7804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:50.250602 7804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:50.250777 7804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:50.254606 7804 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.253:44805
I20260620 22:03:50.254638 7871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.253:44805 every 8 connection(s)
I20260620 22:03:50.254941 7804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
I20260620 22:03:50.255852 7872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:50.257181 7872 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.253@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:03:50.264393 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 7804
I20260620 22:03:50.265038 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.257847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47200 (local address 127.1.55.254:38079)
0620 22:03:50.257919 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.257922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.258078 (+ 156us) server_negotiation.cc:407] Connection header received
0620 22:03:50.258481 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.258482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.258502 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.258545 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.259027 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.259487 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.260366 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.260539 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.260584 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.262468 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.262470 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.262470 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.262476 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.263696 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.264057 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.264057 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.264058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.264101 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.264361 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.264361 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.264362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.264482 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.264572 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.264878 (+ 306us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.264953 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260620 22:03:50.265200 7874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.257795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:47200)
0620 22:03:50.257972 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.258003 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.258403 (+ 400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.258595 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.258598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.258791 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.258947 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.258950 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.259561 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.259562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.260295 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.260297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.260605 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.260606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.260700 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.261065 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.261073 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.262385 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.263764 (+ 1379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.263769 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.263770 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.263993 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.264159 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.264159 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.264159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.264295 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.264578 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.264584 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.264739 (+ 155us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.264854 (+ 115us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.264990 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260620 22:03:50.265841 7872 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.253@KRBTEST.COM for oryx/127.1.55.253@KRBTEST.COM
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.55.253@KRBTEST.COM
I20260620 22:03:50.273123 7874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.266059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.0.0.1:51942)
0620 22:03:50.266107 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.266124 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.266158 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.266370 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.266371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.266507 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.266548 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.266549 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.267191 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.267191 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.267648 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.267649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.268174 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.268175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.268236 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.268663 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.268668 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.269973 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.271912 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.271913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.271914 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.272165 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.272391 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.272392 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.272393 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.272455 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.272719 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.272719 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.272759 (+ 40us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.272860 (+ 101us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.272984 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260620 22:03:50.273167 7877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.266120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.1.55.253:44805)
0620 22:03:50.266250 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.266252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.266258 (+ 6us) server_negotiation.cc:407] Connection header received
0620 22:03:50.266276 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.266276 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.266284 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.266347 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.266627 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.267106 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.267725 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.268098 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.268148 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.270074 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.270081 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.270081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.270087 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.271831 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.272241 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.272244 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.272245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.272307 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.272524 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.272525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.272525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.272648 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.272705 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.272878 (+ 173us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.273037 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":100,"server-negotiator.queue_time_us":111,"thread_start_us":89,"threads_started":1}
I20260620 22:03:50.274294 7876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.265028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51928 (local address 127.1.55.253:44805)
0620 22:03:50.265185 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.265189 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.265204 (+ 15us) server_negotiation.cc:407] Connection header received
0620 22:03:50.265223 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.265225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.265236 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.265466 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.266204 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.267032 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.267850 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.268100 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.268189 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.270767 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.270768 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.270768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.270774 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.273097 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.273508 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.273509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.273510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.273562 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.273785 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.273786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.273786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.273879 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.274029 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.274101 (+ 72us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.274174 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":86,"threads_started":1}
I20260620 22:03:50.274495 7872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Bootstrap starting.
I20260620 22:03:50.275032 7872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:50.275327 7872 log.cc:824] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:50.275981 7872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: No bootstrap required, opened a new log
I20260620 22:03:50.277220 7872 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } }
I20260620 22:03:50.277346 7872 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:50.277390 7872 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1841da354d4b31ad7cf3ab1a7c4bd3, State: Initialized, Role: FOLLOWER
I20260620 22:03:50.277575 7872 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } }
I20260620 22:03:50.277863 7872 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:50.277824 7879 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } } }
I20260620 22:03:50.277920 7879 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: This master's current role is: FOLLOWER
W20260620 22:03:50.279528 7890 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:03:50.279611 7890 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:03:50.280978 7804 master_runner.cc:428] Detected that this master cc1841da354d4b31ad7cf3ab1a7c4bd3 is joining an existing cluster
I20260620 22:03:50.281013 7804 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.55.253:44805
I20260620 22:03:50.287220 7896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.281851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.0.0.1:51952)
0620 22:03:50.281954 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.281963 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.282013 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.282114 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.282114 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.282244 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.282299 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.282300 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.282872 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.282872 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.283400 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.283402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.283815 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.283816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.283874 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.284268 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.284271 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.284515 (+ 244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.286198 (+ 1683us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.286199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.286199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.286390 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.286565 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.286566 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.286566 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.286616 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.286880 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.286881 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.286916 (+ 35us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.287002 (+ 86us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.287119 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":64,"threads_started":1}
I20260620 22:03:50.287257 7876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.281910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51952 (local address 127.1.55.253:44805)
0620 22:03:50.281966 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.281968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.282002 (+ 34us) server_negotiation.cc:407] Connection header received
0620 22:03:50.282061 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.282062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.282069 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.282110 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.282369 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.282786 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.283491 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.283719 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.283802 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.284615 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.284616 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.284616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.284622 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.286108 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.286455 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.286455 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.286456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.286502 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.286686 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.286687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.286687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.286807 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.286888 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.287034 (+ 146us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.287163 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":44}
I20260620 22:03:50.292299 7896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.282002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:47212)
0620 22:03:50.287288 (+ 5286us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.287297 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.287364 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.287508 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.287508 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.287670 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.287720 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.287721 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.288425 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.288425 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.288935 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.288937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.289312 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.289313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.289372 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.289777 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.289780 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.290003 (+ 223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.291335 (+ 1332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.291335 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.291336 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.291477 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.291690 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.291691 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.291691 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.291744 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.291998 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.291999 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.292034 (+ 35us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.292126 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.292220 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5277,"thread_start_us":59,"threads_started":1}
I20260620 22:03:50.292299 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.281866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47212 (local address 127.1.55.254:38079)
0620 22:03:50.281943 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.281945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.287342 (+ 5397us) server_negotiation.cc:407] Connection header received
0620 22:03:50.287411 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.287412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.287420 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.287504 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.287789 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.288330 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.289030 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.289229 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.289311 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.290091 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.290092 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.290093 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.290099 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.291247 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.291544 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.291544 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.291545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.291621 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.291814 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.291815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.291816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.291921 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.291993 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.292152 (+ 159us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.292222 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993027, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.254@KRBTEST.COM for oryx/127.1.55.253@KRBTEST.COM
I20260620 22:03:50.301240 7876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.294713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51966 (local address 127.1.55.253:44805)
0620 22:03:50.294750 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.294751 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.294865 (+ 114us) server_negotiation.cc:407] Connection header received
0620 22:03:50.294934 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.294934 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.294942 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.294992 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.295405 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.295783 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.296843 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.297032 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.297073 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.298986 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.298987 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.298987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.298993 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.300196 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.300554 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.300555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.300555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.300609 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.300795 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.300795 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.300796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.300884 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.300954 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.301108 (+ 154us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.301171 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:03:50.301276 7898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.294638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.0.0.1:51966)
0620 22:03:50.294761 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.294797 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.294868 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.295004 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.295007 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.295296 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.295342 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.295344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.295877 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.295878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.296766 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.296768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.297098 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.297099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.297176 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.297654 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.297659 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.298903 (+ 1244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.300293 (+ 1390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.300299 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.300301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.300471 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.300675 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.300676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.300676 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.300728 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.300950 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.300956 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.300997 (+ 41us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.301094 (+ 97us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.301186 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":75,"threads_started":1}
I20260620 22:03:50.301679 7337 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.55.253:44805: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3"
member_type: NON_VOTER
last_known_addr {
host: "127.1.55.253"
port: 44805
}
attrs {
promote: true
}
}
dest_uuid: "488004efac5449d89be8c0f12a26ca72"
cas_config_opid_index: -1
I20260620 22:03:50.301960 7337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } }
I20260620 22:03:50.302428 7900 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER cc1841da354d4b31ad7cf3ab1a7c4bd3 (127.1.55.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } }
I20260620 22:03:50.302891 7846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:50.303483 7900 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.55.253:44805
I20260620 22:03:50.303694 7846 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Refusing update from remote peer 488004efac5449d89be8c0f12a26ca72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260620 22:03:50.303704 7804 master.cc:537] Master@127.1.55.253:44805 shutting down...
I20260620 22:03:50.303717 7901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } }
I20260620 22:03:50.303783 7901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:50.304186 7901 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 22:03:50.304960 7324 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260620 22:03:50.305369 7324 consensus_peers.cc:487] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 -> Peer cc1841da354d4b31ad7cf3ab1a7c4bd3 (127.1.55.253:44805): Couldn't send request to peer cc1841da354d4b31ad7cf3ab1a7c4bd3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260620 22:03:50.306360 7804 raft_consensus.cc:2229] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:50.306442 7804 raft_consensus.cc:2258] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:50.306507 7804 tablet_replica.cc:330] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: stopping tablet replica
I20260620 22:03:50.318912 7804 master.cc:552] Master@127.1.55.253:44805 shutdown complete.
I20260620 22:03:50.318957 7804 master_runner.cc:305] Clearing existing system tablet
I20260620 22:03:50.319080 7804 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.319132 7804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.319782 7804 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s
I20260620 22:03:50.320308 7905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.320426 7804 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.320482 7804 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.320505 7804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "2f86f0b42fe6dde4b791effd6a233f06"
server_key_iv: "c02bf2a7655a26a9b04915d03ce59da8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.321098 7804 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:50.322572 7804 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260620 22:03:50.322633 7804 log.cc:1196] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260620 22:03:50.322826 7804 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Deleting consensus metadata
I20260620 22:03:50.322953 7804 master_runner.cc:315] Copying system tablet from 127.1.55.254:38079
I20260620 22:03:50.323521 7804 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: tablet copy: Beginning tablet copy session from remote peer at address 127.1.55.254:38079
I20260620 22:03:50.329393 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.323833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47228 (local address 127.1.55.254:38079)
0620 22:03:50.323884 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.323886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.324001 (+ 115us) server_negotiation.cc:407] Connection header received
0620 22:03:50.324039 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.324040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.324047 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.324085 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.324372 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.324832 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.325694 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.325901 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.325986 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.326828 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.326829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.326830 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.326836 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.328257 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.328603 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.328604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.328604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.328668 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.328876 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.328877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.328877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.328981 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.329054 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.329247 (+ 193us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.329311 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:03:50.329411 7911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.323768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:47228)
0620 22:03:50.323927 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.323937 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.323994 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.324097 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.324098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.324263 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.324314 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.324315 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.324931 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.324932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.325605 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.325607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.325988 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.325989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.326052 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.326489 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.326493 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.326738 (+ 245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.328347 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.328348 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.328348 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.328508 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.328760 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.328761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.328761 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.328810 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.329057 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.329058 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.329099 (+ 41us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.329221 (+ 122us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.329312 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":79,"threads_started":1}
I20260620 22:03:50.329684 7358 tablet_copy_service.cc:140] P 488004efac5449d89be8c0f12a26ca72: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer cc1841da354d4b31ad7cf3ab1a7c4bd3 ({username='oryx', principal='oryx/127.1.55.253@KRBTEST.COM'} at 127.0.0.1:47228)
I20260620 22:03:50.329764 7358 tablet_copy_service.cc:161] P 488004efac5449d89be8c0f12a26ca72: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer cc1841da354d4b31ad7cf3ab1a7c4bd3 at {username='oryx', principal='oryx/127.1.55.253@KRBTEST.COM'} at 127.0.0.1:47228: session id = cc1841da354d4b31ad7cf3ab1a7c4bd3-00000000000000000000000000000000
I20260620 22:03:50.330315 7358 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 22:03:50.330812 7804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260620 22:03:50.331475 7804 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: tablet copy: Starting download of 0 data blocks...
I20260620 22:03:50.331614 7804 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: tablet copy: Starting download of 1 WAL segments...
I20260620 22:03:50.332355 7804 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 22:03:50.332993 7358 tablet_copy_service.cc:342] P 488004efac5449d89be8c0f12a26ca72: Request end of tablet copy session cc1841da354d4b31ad7cf3ab1a7c4bd3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.55.253@KRBTEST.COM'} at 127.0.0.1:47228
I20260620 22:03:50.333040 7358 tablet_copy_service.cc:433] P 488004efac5449d89be8c0f12a26ca72: ending tablet copy session cc1841da354d4b31ad7cf3ab1a7c4bd3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer cc1841da354d4b31ad7cf3ab1a7c4bd3
I20260620 22:03:50.335319 7804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:50.336452 7912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.336555 7915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.336591 7804 server_base.cc:1034] running on GCE node
W20260620 22:03:50.336730 7913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.336866 7804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:50.337025 7804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:50.338151 7804 hybrid_clock.cc:648] HybridClock initialized: now 1781993030338137 us; error 27 us; skew 500 ppm
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:50.339222 7804 init.cc:377] Logged in from keytab as oryx/127.1.55.253@KRBTEST.COM (short username oryx)
I20260620 22:03:50.339479 7804 webserver.cc:460] Webserver started at http://127.1.55.253:38711/ using document root <none> and password file <none>
I20260620 22:03:50.339612 7804 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.339646 7804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.340206 7804 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.340713 7922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.340821 7804 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.340858 7804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "2f86f0b42fe6dde4b791effd6a233f06"
server_key_iv: "c02bf2a7655a26a9b04915d03ce59da8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.340905 7804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.347211 7804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:50.348660 7804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:50.351747 7804 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.253:44805
I20260620 22:03:50.351761 7974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.253:44805 every 8 connection(s)
I20260620 22:03:50.352175 7804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
I20260620 22:03:50.352741 7975 sys_catalog.cc:263] Verifying existing consensus state
I20260620 22:03:50.353245 7975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Bootstrap starting.
I20260620 22:03:50.355513 7975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:03:50.355742 7975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: Bootstrap complete.
I20260620 22:03:50.355947 7975 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } }
I20260620 22:03:50.356020 7975 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cc1841da354d4b31ad7cf3ab1a7c4bd3, State: Initialized, Role: LEARNER
I20260620 22:03:50.356045 7975 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } }
I20260620 22:03:50.356202 7975 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:50.356225 7978 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } }
I20260620 22:03:50.356325 7978 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: This master's current role is: LEARNER
I20260620 22:03:50.357535 7989 catalog_manager.cc:1259] Loaded cluster ID: ebe1a99a91e34386a6b35130d40ae2d4
I20260620 22:03:50.357613 7989 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: loading cluster ID for follower catalog manager: success
I20260620 22:03:50.358551 7989 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: acquiring CA information for follower catalog manager: success
I20260620 22:03:50.358824 7989 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 22:03:50.383004 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.375612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51984 (local address 127.1.55.253:44805)
0620 22:03:50.375761 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.375763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.375774 (+ 11us) server_negotiation.cc:407] Connection header received
0620 22:03:50.375802 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.375802 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.375813 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.375890 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.376414 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.377544 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.378679 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.379038 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.379111 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.380317 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.380319 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.380319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.380326 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.381913 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.382238 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.382239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.382240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.382300 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.382477 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.382478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.382478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.382603 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.382699 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.382808 (+ 109us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.382884 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for oryx/127.1.55.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.252.keytab.
Entry for principal oryx/127.1.55.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.252.keytab.
I20260620 22:03:50.408178 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.252:45675
--webserver_interface=127.1.55.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.252.keytab
--principal=oryx/127.1.55.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:03:50.484246 7993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:50.484407 7993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:50.484426 7993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:50.485394 7993 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:03:50.485427 7993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:50.485440 7993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:50.485450 7993 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:03:50.485461 7993 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:03:50.487032 7993 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.252.keytab
--principal=oryx/127.1.55.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.252:45675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.55.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:50.487190 7993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:50.487325 7993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:50.491761 7998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.491940 7993 server_base.cc:1034] running on GCE node
W20260620 22:03:50.491770 8001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.491779 7999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.492208 7993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:50.492452 7993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:50.493525 7993 hybrid_clock.cc:648] HybridClock initialized: now 1781993030493512 us; error 26 us; skew 500 ppm
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:50.495723 7993 init.cc:377] Logged in from keytab as oryx/127.1.55.252@KRBTEST.COM (short username oryx)
I20260620 22:03:50.496243 7993 webserver.cc:460] Webserver started at http://127.1.55.252:40973/ using document root <none> and password file <none>
I20260620 22:03:50.496491 7993 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.496570 7993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.496701 7993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:03:50.497697 7993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data/instance:
uuid: "f5fbf2da6bc24e91894cf813a13aa0cf"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "e9ca801b8cf95f75d94a2fea77fbb657"
server_key_iv: "0a53faa3dca5ba4c9d42f61d28d66810"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.498011 7993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal/instance:
uuid: "f5fbf2da6bc24e91894cf813a13aa0cf"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "e9ca801b8cf95f75d94a2fea77fbb657"
server_key_iv: "0a53faa3dca5ba4c9d42f61d28d66810"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.499146 7993 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:50.500217 8008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.500401 7993 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:50.500478 7993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
uuid: "f5fbf2da6bc24e91894cf813a13aa0cf"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "e9ca801b8cf95f75d94a2fea77fbb657"
server_key_iv: "0a53faa3dca5ba4c9d42f61d28d66810"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.500555 7993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.527856 7993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:50.529593 7993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:50.529726 7993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:50.533631 7993 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.252:45675
I20260620 22:03:50.533681 8060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.252:45675 every 8 connection(s)
I20260620 22:03:50.533972 7993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
I20260620 22:03:50.534830 8061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:50.536144 8061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.252@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:03:50.542992 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 7993
I20260620 22:03:50.544741 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.536824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47240 (local address 127.1.55.254:38079)
0620 22:03:50.536905 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.536907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.537038 (+ 131us) server_negotiation.cc:407] Connection header received
0620 22:03:50.537577 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.537578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.537590 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.537657 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.538215 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.538703 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.539682 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.539887 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.539973 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.542019 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.542021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.542021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.542027 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.543350 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.543796 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.543797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.543798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.543871 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.544133 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.544134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.544135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.544251 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.544332 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.544574 (+ 242us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.544656 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260620 22:03:50.544898 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.536702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:47240)
0620 22:03:50.536895 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.536938 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.537430 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.537725 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.537729 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.537939 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.538104 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.538107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.538806 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.538809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.539570 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.539572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.539981 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.539982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.540097 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.540468 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.540474 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.541907 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.543457 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.543460 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.543462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.543718 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.543960 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.543961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.543961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.544055 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.544323 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.544328 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.544445 (+ 117us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.544549 (+ 104us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.544691 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":102,"threads_started":1}
I20260620 22:03:50.545365 8061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.55.252@KRBTEST.COM
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.252@KRBTEST.COM for oryx/127.1.55.253@KRBTEST.COM
I20260620 22:03:50.551561 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.545626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.0.0.1:52000)
0620 22:03:50.545661 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.545670 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.545699 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.545906 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.545906 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.546030 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.546071 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.546072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.546735 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.546735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.547219 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.547221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.547644 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.547644 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.547710 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.548054 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.548059 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.549310 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.550658 (+ 1348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.550659 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.550659 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.550835 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.550992 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.550993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.550993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.551039 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.551293 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.551294 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.551330 (+ 36us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.551406 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.551484 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260620 22:03:50.551577 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.545686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52000 (local address 127.1.55.253:44805)
0620 22:03:50.545762 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.545764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.545771 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:03:50.545795 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.545796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.545808 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.545902 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.546160 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.546622 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.547307 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.547544 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.547643 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.549395 (+ 1752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.549396 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.549396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.549403 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.550553 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.550901 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.550902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.550903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.550950 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.551111 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.551112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.551113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.551222 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.551300 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.551428 (+ 128us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.551499 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260620 22:03:50.551952 8061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45675 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:03:50.552170 8064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.543458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58002 (local address 127.1.55.252:45675)
0620 22:03:50.543619 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.543623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.543642 (+ 19us) server_negotiation.cc:407] Connection header received
0620 22:03:50.543663 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.543664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.543674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.543761 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.544311 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.545106 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.546070 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.546362 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.546452 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.548937 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.548942 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.548943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.548947 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.550546 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.551015 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.551017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.551017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.551054 (+ 37us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.551258 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.551259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.551259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.551398 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.551527 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.551984 (+ 457us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.552072 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.252@KRBTEST.COM for oryx/127.1.55.252@KRBTEST.COM
I20260620 22:03:50.557621 8064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.552231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58010 (local address 127.1.55.252:45675)
0620 22:03:50.552266 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.552268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.552400 (+ 132us) server_negotiation.cc:407] Connection header received
0620 22:03:50.552436 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.552437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.552446 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.552491 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.552722 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.553122 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.553794 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.553954 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.553999 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.555501 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.555502 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.555502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.555508 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.556688 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.556968 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.556968 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.556969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.557024 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.557186 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.557186 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.557186 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.557310 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.557353 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.557452 (+ 99us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.557575 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21,"thread_start_us":71,"threads_started":1}
I20260620 22:03:50.557708 8063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.552200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45675 (local address 127.0.0.1:58010)
0620 22:03:50.552325 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.552333 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.552379 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.552494 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.552495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.552626 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.552655 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.552657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.553186 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.553187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.553711 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.553712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.554012 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.554012 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.554044 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.554373 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.554377 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.555422 (+ 1045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.556755 (+ 1333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.556756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.556756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.556901 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.557099 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.557100 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.557100 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.557150 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.557364 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.557365 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.557392 (+ 27us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.557439 (+ 47us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.557641 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":94}
I20260620 22:03:50.558704 8061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Bootstrap starting.
I20260620 22:03:50.559427 8061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:50.559692 8061 log.cc:824] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:50.560335 8061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: No bootstrap required, opened a new log
I20260620 22:03:50.561622 8061 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45675 } }
I20260620 22:03:50.561717 8061 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:50.561736 8061 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5fbf2da6bc24e91894cf813a13aa0cf, State: Initialized, Role: FOLLOWER
I20260620 22:03:50.561858 8061 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45675 } }
I20260620 22:03:50.562110 8061 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:50.562086 8067 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45675 } } }
I20260620 22:03:50.562186 8067 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: This master's current role is: FOLLOWER
W20260620 22:03:50.563866 8078 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:03:50.563941 8078 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:03:50.565979 7993 master_runner.cc:428] Detected that this master f5fbf2da6bc24e91894cf813a13aa0cf is joining an existing cluster
I20260620 22:03:50.566040 7993 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.55.252:45675
I20260620 22:03:50.572520 8084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.567193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45675 (local address 127.0.0.1:58026)
0620 22:03:50.567330 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.567358 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.567411 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.567569 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.567570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.567714 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.567775 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.567777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.568382 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.568383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.568988 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.568990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.569318 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.569319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.569374 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.569755 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.569759 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.569996 (+ 237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.571560 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.571561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.571561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.571737 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.571943 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.571944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.571944 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.572007 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.572242 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.572242 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.572274 (+ 32us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.572327 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.572413 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260620 22:03:50.572568 8064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.567321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58026 (local address 127.1.55.252:45675)
0620 22:03:50.567372 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.567373 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.567398 (+ 25us) server_negotiation.cc:407] Connection header received
0620 22:03:50.567475 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.567476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.567501 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.567548 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.567855 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.568288 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.569080 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.569230 (+ 150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.569307 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.570097 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.570098 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.570098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.570104 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.571447 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.571820 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.571821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.571821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.571870 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.572068 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.572069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.572069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.572180 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.572249 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.572352 (+ 103us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.572456 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":36}
I20260620 22:03:50.579319 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.573323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52002 (local address 127.1.55.253:44805)
0620 22:03:50.573361 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.573363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.573694 (+ 331us) server_negotiation.cc:407] Connection header received
0620 22:03:50.573749 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.573750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.573758 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.573821 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.574166 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.574824 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.575854 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.576155 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.576224 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.577108 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.577109 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.577109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.577114 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.578343 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.578691 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.578691 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.578691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.578732 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.578935 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.578935 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.578935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.579017 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.579062 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.579213 (+ 151us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.579265 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:03:50.579375 8085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.573509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.0.0.1:52002)
0620 22:03:50.573643 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.573652 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.573703 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.573845 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.573846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.574048 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.574092 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.574093 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.574904 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.574904 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.575733 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.575735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.576240 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.576241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.576305 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.576685 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.576689 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.577027 (+ 338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.578422 (+ 1395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.578423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.578423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.578624 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.578814 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.578815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.578815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.578875 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.579081 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.579082 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.579121 (+ 39us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.579191 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.579276 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":2,"thread_start_us":77,"threads_started":1}
I20260620 22:03:50.603263 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 7400
I20260620 22:03:50.608070 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:39339
--local_ip_for_outbound_sockets=127.1.55.193
--tserver_master_addrs=127.1.55.254:38079
--webserver_port=36519
--webserver_interface=127.1.55.193
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab
--principal=oryx/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:03:50.612550 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.573529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47246 (local address 127.1.55.254:38079)
0620 22:03:50.573613 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.573616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.573655 (+ 39us) server_negotiation.cc:407] Connection header received
0620 22:03:50.573847 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.573848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.573854 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.573913 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.574232 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.574856 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.575518 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.575706 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.575774 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.609832 (+ 34058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.609833 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.609833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.609841 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.611379 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.611775 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.611776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.611776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.611831 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.612042 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.612043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.612043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.612165 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.612227 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.612395 (+ 168us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.612466 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260620 22:03:50.612594 8084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.573447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:47246)
0620 22:03:50.573611 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.573622 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.573668 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.573916 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.573916 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.574085 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.574149 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.574151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.574929 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.574930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.575423 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.575424 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.575783 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.575784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.575865 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.576272 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.576277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.609738 (+ 33461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.611471 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.611472 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.611472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.611685 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.611904 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.611905 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.611906 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.611969 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.612237 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.612237 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.612282 (+ 45us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.612357 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.612455 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":33}
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993027, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.254@KRBTEST.COM for oryx/127.1.55.252@KRBTEST.COM
I20260620 22:03:50.622347 7898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.614680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45675 (local address 127.0.0.1:58040)
0620 22:03:50.614730 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.614740 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.614774 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.614963 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.614964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.615107 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.615144 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.615146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.616051 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.616052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.616857 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.616859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.617371 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.617372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.617441 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.617963 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.617980 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.619354 (+ 1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.621208 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.621208 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.621209 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.621416 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.621714 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.621715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.621715 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.621776 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.622046 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.622047 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.622095 (+ 48us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.622162 (+ 67us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.622254 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260620 22:03:50.622355 8064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.614721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58040 (local address 127.1.55.252:45675)
0620 22:03:50.614840 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.614841 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.614848 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:03:50.614876 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.614876 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.614886 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.614940 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.615225 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.615952 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.616951 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.617277 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.617354 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.619439 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.619440 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.619441 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.619446 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.621087 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.621572 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.621573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.621574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.621637 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.621856 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.621856 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.621857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.621978 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.622046 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.622211 (+ 165us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.622282 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260620 22:03:50.623106 7337 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.55.252:45675: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf"
member_type: NON_VOTER
last_known_addr {
host: "127.1.55.252"
port: 45675
}
attrs {
promote: true
}
}
dest_uuid: "488004efac5449d89be8c0f12a26ca72"
cas_config_opid_index: 5
I20260620 22:03:50.623342 7337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:03:50.623672 7901 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER f5fbf2da6bc24e91894cf813a13aa0cf (127.1.55.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.624627 7901 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.55.252:45675
I20260620 22:03:50.624698 7901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.624765 7901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:50.625103 8035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:50.626001 8035 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 1 FOLLOWER]: Refusing update from remote peer 488004efac5449d89be8c0f12a26ca72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260620 22:03:50.626238 7900 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:50.626675 7993 master.cc:537] Master@127.1.55.252:45675 shutting down...
I20260620 22:03:50.627693 8035 raft_consensus.cc:858] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45675 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
W20260620 22:03:50.627765 8035 raft_consensus.cc:1565] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45675 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:03:50.628253 8035 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER cc1841da354d4b31ad7cf3ab1a7c4bd3 (127.1.55.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } }
I20260620 22:03:50.629328 8067 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 488004efac5449d89be8c0f12a26ca72. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } }
I20260620 22:03:50.629397 8067 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260620 22:03:50.629451 8067 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } }
I20260620 22:03:50.629510 8067 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260620 22:03:50.629551 8067 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } }
I20260620 22:03:50.629597 8067 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260620 22:03:50.629628 8087 mvcc.cc:205] Tried to move back new op lower bound from 7299043442065416192 to 7299043441952092160. Current Snapshot: MvccSnapshot[applied={T|T < 7299043441962582016}]
I20260620 22:03:50.630438 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.624851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52012 (local address 127.1.55.253:44805)
0620 22:03:50.624893 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.624895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.624904 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:50.624925 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.624926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.624947 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.625008 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:50.625205 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.626032 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.629299 (+ 3267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.629971 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.630016 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.630081 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.630338 (+ 257us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.630372 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:03:50.630726 7898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.623760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.0.0.1:52012)
0620 22:03:50.623890 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.623899 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.623936 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.625059 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.625060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.625062 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:50.625105 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.625106 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.626188 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.626189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.629204 (+ 3015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.629207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.630191 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.630192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.630253 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.630270 (+ 17us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.630629 (+ 359us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.630665 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260620 22:03:50.631139 7949 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 LEARNER]: Refusing update from remote peer 488004efac5449d89be8c0f12a26ca72: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260620 22:03:50.631310 7900 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260620 22:03:50.631757 7949 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER f5fbf2da6bc24e91894cf813a13aa0cf (127.1.55.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.632155 7993 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260620 22:03:50.632232 7993 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260620 22:03:50.632257 7993 tablet_replica.cc:330] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: stopping tablet replica
I20260620 22:03:50.632767 7978 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 488004efac5449d89be8c0f12a26ca72. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.632850 7978 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: This master's current role is: LEARNER
I20260620 22:03:50.632879 7978 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.632917 7978 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: This master's current role is: LEARNER
I20260620 22:03:50.633809 7900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: NON_VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: true } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.633878 7900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: This master's current role is: LEADER
W20260620 22:03:50.634238 7322 consensus_peers.cc:487] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 -> Peer f5fbf2da6bc24e91894cf813a13aa0cf (127.1.55.252:45675): Couldn't send request to peer f5fbf2da6bc24e91894cf813a13aa0cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260620 22:03:50.635641 7901 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: attempting to promote NON_VOTER cc1841da354d4b31ad7cf3ab1a7c4bd3 to VOTER
I20260620 22:03:50.635787 7901 consensus_queue.cc:237] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:03:50.636312 7898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.636189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45675 (local address 127.0.0.1:58052)
0620 22:03:50.636246 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.636289 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260620 22:03:50.636344 7949 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 LEARNER]: Refusing update from remote peer 488004efac5449d89be8c0f12a26ca72: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260620 22:03:50.636543 8096 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260620 22:03:50.636713 7898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.636599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45675 (local address 127.0.0.1:58066)
0620 22:03:50.636669 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.636692 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45675: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260620 22:03:50.636838 7322 consensus_peers.cc:487] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 -> Peer f5fbf2da6bc24e91894cf813a13aa0cf (127.1.55.252:45675): Couldn't send request to peer f5fbf2da6bc24e91894cf813a13aa0cf. Status: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45675: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 22:03:50.637146 7900 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, cc1841da354d4b31ad7cf3ab1a7c4bd3 (127.1.55.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.637728 7949 raft_consensus.cc:2932] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, cc1841da354d4b31ad7cf3ab1a7c4bd3 (127.1.55.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.638109 7900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.638172 7900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:50.638211 7900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.638242 7900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72 [sys.catalog]: This master's current role is: LEADER
I20260620 22:03:50.638502 8095 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "488004efac5449d89be8c0f12a26ca72" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.638578 8095 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:03:50.652710 7993 master.cc:552] Master@127.1.55.252:45675 shutdown complete.
I20260620 22:03:50.652756 7993 master_runner.cc:305] Clearing existing system tablet
I20260620 22:03:50.652858 7993 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.652894 7993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.653620 7993 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:50.654196 8098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.654358 7993 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.654407 7993 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.654428 7993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
uuid: "f5fbf2da6bc24e91894cf813a13aa0cf"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "e9ca801b8cf95f75d94a2fea77fbb657"
server_key_iv: "0a53faa3dca5ba4c9d42f61d28d66810"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.654985 7993 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:50.656411 7993 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260620 22:03:50.656478 7993 log.cc:1196] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260620 22:03:50.656793 7993 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Deleting consensus metadata
I20260620 22:03:50.656945 7993 master_runner.cc:315] Copying system tablet from 127.1.55.254:38079
I20260620 22:03:50.657497 7993 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: tablet copy: Beginning tablet copy session from remote peer at address 127.1.55.254:38079
I20260620 22:03:50.667986 8104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.657745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:47254)
0620 22:03:50.661576 (+ 3831us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.661646 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.661714 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.661835 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.661836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.661998 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.662056 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.662057 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.662940 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.662941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.663695 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.663698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.664122 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.664123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.664173 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.664622 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.664627 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.664956 (+ 329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.666885 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.666886 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.666886 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.667112 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.667307 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.667308 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.667308 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.667363 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.667663 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.667664 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.667715 (+ 51us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.667790 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.667883 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3811,"thread_start_us":59,"threads_started":1}
I20260620 22:03:50.668000 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.657815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47254 (local address 127.1.55.254:38079)
0620 22:03:50.657871 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.657872 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.661724 (+ 3852us) server_negotiation.cc:407] Connection header received
0620 22:03:50.661755 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.661755 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.661765 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.661829 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.662127 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.662864 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.663777 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.664039 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.664109 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.665048 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.665049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.665050 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.665056 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.666770 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.667183 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.667185 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.667185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.667241 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.667429 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.667430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.667430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.667586 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.667664 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.667835 (+ 171us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.667910 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:03:50.668612 7358 tablet_copy_service.cc:140] P 488004efac5449d89be8c0f12a26ca72: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f5fbf2da6bc24e91894cf813a13aa0cf ({username='oryx', principal='oryx/127.1.55.252@KRBTEST.COM'} at 127.0.0.1:47254)
I20260620 22:03:50.668699 7358 tablet_copy_service.cc:161] P 488004efac5449d89be8c0f12a26ca72: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f5fbf2da6bc24e91894cf813a13aa0cf at {username='oryx', principal='oryx/127.1.55.252@KRBTEST.COM'} at 127.0.0.1:47254: session id = f5fbf2da6bc24e91894cf813a13aa0cf-00000000000000000000000000000000
I20260620 22:03:50.669194 7358 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: Tablet Copy: opened 0 blocks and 1 log segments
I20260620 22:03:50.669625 7993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260620 22:03:50.670576 7993 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: tablet copy: Starting download of 0 data blocks...
I20260620 22:03:50.670698 7993 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: tablet copy: Starting download of 1 WAL segments...
I20260620 22:03:50.671469 7993 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260620 22:03:50.672461 7358 tablet_copy_service.cc:342] P 488004efac5449d89be8c0f12a26ca72: Request end of tablet copy session f5fbf2da6bc24e91894cf813a13aa0cf-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.55.252@KRBTEST.COM'} at 127.0.0.1:47254
I20260620 22:03:50.672505 7358 tablet_copy_service.cc:433] P 488004efac5449d89be8c0f12a26ca72: ending tablet copy session f5fbf2da6bc24e91894cf813a13aa0cf-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f5fbf2da6bc24e91894cf813a13aa0cf
I20260620 22:03:50.676316 7993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:50.677335 8108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.677448 8105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.677649 8106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.678059 7993 server_base.cc:1034] running on GCE node
I20260620 22:03:50.678174 7993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:50.678277 7993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:50.679395 7993 hybrid_clock.cc:648] HybridClock initialized: now 1781993030679383 us; error 25 us; skew 500 ppm
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:50.680795 7993 init.cc:377] Logged in from keytab as oryx/127.1.55.252@KRBTEST.COM (short username oryx)
I20260620 22:03:50.681002 7993 webserver.cc:460] Webserver started at http://127.1.55.252:34899/ using document root <none> and password file <none>
I20260620 22:03:50.681104 7993 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.681128 7993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.681742 7993 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.682276 8115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.682433 7993 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.682476 7993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
uuid: "f5fbf2da6bc24e91894cf813a13aa0cf"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "e9ca801b8cf95f75d94a2fea77fbb657"
server_key_iv: "0a53faa3dca5ba4c9d42f61d28d66810"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.682515 7993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.700718 7993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:50.702450 7993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:50.705189 7993 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.252:45675
I20260620 22:03:50.705590 8167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.252:45675 every 8 connection(s)
I20260620 22:03:50.705714 7993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
I20260620 22:03:50.706524 8171 sys_catalog.cc:263] Verifying existing consensus state
I20260620 22:03:50.706930 8171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Bootstrap starting.
W20260620 22:03:50.707522 8086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:50.707685 8086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:50.707706 8086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260620 22:03:50.708724 8171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260620 22:03:50.708891 8086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:50.708940 8086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:50.708967 8086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:03:50.708935 8171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: Bootstrap complete.
I20260620 22:03:50.709136 8171 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:03:50.709225 8171 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5fbf2da6bc24e91894cf813a13aa0cf, State: Initialized, Role: LEARNER
I20260620 22:03:50.709280 8171 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:03:50.709527 8171 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:03:50.709507 8174 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } } }
I20260620 22:03:50.709584 8174 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf [sys.catalog]: This master's current role is: LEARNER
I20260620 22:03:50.711112 8086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab
--principal=oryx/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:39339
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=36519
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:50.711309 8086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:50.711488 8185 catalog_manager.cc:1259] Loaded cluster ID: ebe1a99a91e34386a6b35130d40ae2d4
I20260620 22:03:50.711525 8185 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: loading cluster ID for follower catalog manager: success
I20260620 22:03:50.711530 8086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:03:50.712468 8185 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: acquiring CA information for follower catalog manager: success
I20260620 22:03:50.712731 8185 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f5fbf2da6bc24e91894cf813a13aa0cf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260620 22:03:50.716018 8190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.716015 8187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.716022 8188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.716177 8086 server_base.cc:1034] running on GCE node
I20260620 22:03:50.716344 8086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:50.716600 8086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:50.717767 8086 hybrid_clock.cc:648] HybridClock initialized: now 1781993030717747 us; error 29 us; skew 500 ppm
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:50.720072 8086 init.cc:377] Logged in from keytab as oryx/127.1.55.193@KRBTEST.COM (short username oryx)
I20260620 22:03:50.720512 8086 webserver.cc:460] Webserver started at http://127.1.55.193:36519/ using document root <none> and password file <none>
I20260620 22:03:50.720789 8086 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.720868 8086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.722239 8086 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260620 22:03:50.722712 8197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.722874 8086 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.722945 8086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "7637e08ae62f424080b476557b0e31b3"
format_stamp: "Formatted at 2026-06-20 22:03:48 on dist-test-slave-xw35"
server_key: "d295b6a16dd6006ebd04e491c546534d"
server_key_iv: "fff31744fb0686239414d14168b6368c"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.723197 8086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.743096 8086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:50.745044 8086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:50.745134 8086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:50.745272 8086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:50.745460 8086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:50.745510 8086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.745527 8086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:50.745541 8086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.750960 8086 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:39339
I20260620 22:03:50.751065 8310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:39339 every 8 connection(s)
I20260620 22:03:50.751281 8086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:03:50.753134 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 8086
I20260620 22:03:50.753296 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 7535
I20260620 22:03:50.758558 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:42373
--local_ip_for_outbound_sockets=127.1.55.194
--tserver_master_addrs=127.1.55.254:38079
--webserver_port=40215
--webserver_interface=127.1.55.194
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab
--principal=oryx/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.253@KRBTEST.COM
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.252@KRBTEST.COM
I20260620 22:03:50.763303 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.752073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:47333 (local address 127.1.55.253:44805)
0620 22:03:50.752113 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.752115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.752892 (+ 777us) server_negotiation.cc:407] Connection header received
0620 22:03:50.752915 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.752916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.752927 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.752982 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.754758 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.755384 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.756550 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.756790 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.756860 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.760168 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.760169 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.760169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.760175 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.761742 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.762272 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.762273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.762273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.762321 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.762615 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.762616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.762616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.762749 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.762791 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.763145 (+ 354us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.763220 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:03:50.763453 8317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.751908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:55983)
0620 22:03:50.752170 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.752209 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.752628 (+ 419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.752898 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.752903 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.754434 (+ 1531us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.754547 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.754551 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.755460 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.755462 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.756694 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.756697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.757175 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.757176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.757255 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.757705 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.757710 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.759732 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.761962 (+ 2230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.761963 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.761963 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.762193 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.762386 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.762387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.762387 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.762538 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.762862 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.762863 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.762986 (+ 123us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.763090 (+ 104us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.763234 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":2,"thread_start_us":76,"threads_started":1}
I20260620 22:03:50.763613 8315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.751908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.1.55.193:47333)
0620 22:03:50.752796 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.752805 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.752853 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.753016 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.753017 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.753355 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.754669 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.754671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.755476 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.755477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.756421 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.756423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.756867 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.756868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.756997 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.757506 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.757516 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.759732 (+ 2216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.761824 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.761830 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.761832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.762194 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.762387 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.762387 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.762388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.762537 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.762839 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.762845 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.762986 (+ 141us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.763407 (+ 421us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.763521 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":862,"mutex_wait_us":63,"thread_start_us":83,"threads_started":1}
I20260620 22:03:50.763985 8313 heartbeater.cc:347] Connected to a master server at 127.1.55.253:44805
I20260620 22:03:50.764081 8313 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:50.764377 8313 heartbeater.cc:511] Master 127.1.55.253:44805 requested a full tablet report, sending...
I20260620 22:03:50.764892 7939 ts_manager.cc:194] Registered new tserver with Master: 7637e08ae62f424080b476557b0e31b3 (127.1.55.193:39339)
I20260620 22:03:50.765601 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.751952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:55983 (local address 127.1.55.254:38079)
0620 22:03:50.751994 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.751996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.752292 (+ 296us) server_negotiation.cc:407] Connection header received
0620 22:03:50.752736 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.752737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.752750 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.752806 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.754645 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.755345 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.756784 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.757068 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.757124 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.759817 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.759819 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.759819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.759827 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.761896 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.762268 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.762268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.762269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.762321 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.762617 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.762618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.762618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.762738 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.762797 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.765413 (+ 2616us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.765522 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:03:50.765913 8312 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38079
I20260620 22:03:50.765955 8312 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:50.766012 8312 heartbeater.cc:511] Master 127.1.55.254:38079 requested a full tablet report, sending...
I20260620 22:03:50.766252 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.752136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:51499 (local address 127.1.55.252:45675)
0620 22:03:50.752270 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.752272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.753290 (+ 1018us) server_negotiation.cc:407] Connection header received
0620 22:03:50.753313 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.753314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.753326 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.758042 (+ 4716us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.758401 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.759332 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.760265 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.760557 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.760640 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.763085 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.763086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.763087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.763095 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.764995 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.765361 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.765362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.765363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.765419 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.765649 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.765650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.765650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.765779 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.765890 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.766081 (+ 191us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.766170 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":95,"threads_started":1}
I20260620 22:03:50.766247 7337 ts_manager.cc:194] Re-registered known tserver with Master: 7637e08ae62f424080b476557b0e31b3 (127.1.55.193:39339)
I20260620 22:03:50.766701 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.751908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45675 (local address 127.1.55.193:51499)
0620 22:03:50.753183 (+ 1275us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.753192 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.753244 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.758079 (+ 4835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.758080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.758223 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.758283 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.758284 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.759415 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.759416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.760174 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.760177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.760692 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.760693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.760749 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.761464 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.761468 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.762981 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.765082 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.765083 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.765084 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.765274 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.765514 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.765514 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.765515 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.765577 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.765915 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.765916 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.765963 (+ 47us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.766326 (+ 363us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.766414 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":984,"mutex_wait_us":3,"spinlock_wait_cycles":5888,"thread_start_us":92,"threads_started":1}
I20260620 22:03:50.766727 7337 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:55983
I20260620 22:03:50.767088 8311 heartbeater.cc:347] Connected to a master server at 127.1.55.252:45675
I20260620 22:03:50.767130 8311 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:50.767182 8311 heartbeater.cc:511] Master 127.1.55.252:45675 requested a full tablet report, sending...
I20260620 22:03:50.767554 8132 ts_manager.cc:194] Registered new tserver with Master: 7637e08ae62f424080b476557b0e31b3 (127.1.55.193:39339)
W20260620 22:03:50.836580 8319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:50.836752 8319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:50.836774 8319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:50.837932 8319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:50.837968 8319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:50.838021 8319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:03:50.839339 8319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab
--principal=oryx/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:42373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=40215
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:50.839486 8319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:50.839709 8319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:03:50.844383 8319 server_base.cc:1034] running on GCE node
W20260620 22:03:50.844337 8327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.844333 8324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.844360 8325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.844732 8319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:50.844967 8319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:50.846128 8319 hybrid_clock.cc:648] HybridClock initialized: now 1781993030846113 us; error 25 us; skew 500 ppm
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:50.848393 8319 init.cc:377] Logged in from keytab as oryx/127.1.55.194@KRBTEST.COM (short username oryx)
I20260620 22:03:50.848801 8319 webserver.cc:460] Webserver started at http://127.1.55.194:40215/ using document root <none> and password file <none>
I20260620 22:03:50.848950 8319 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.848994 8319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.850152 8319 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260620 22:03:50.850652 8334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.850822 8319 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.850893 8319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "86c7aa64a4424ce1bcfe31ee449b1913"
format_stamp: "Formatted at 2026-06-20 22:03:49 on dist-test-slave-xw35"
server_key: "8631f8f5aee9d3e79262d35172de12e0"
server_key_iv: "9dfbe2254ec7a98dc707cc6faab37df1"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.851130 8319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:50.858183 8319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:50.860196 8319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:50.860289 8319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:50.860427 8319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:50.860628 8319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:50.860654 8319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.860671 8319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:50.860682 8319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.865691 8319 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:42373
I20260620 22:03:50.865758 8447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:42373 every 8 connection(s)
I20260620 22:03:50.866066 8319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.252@KRBTEST.COM
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.253@KRBTEST.COM
I20260620 22:03:50.873719 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 8319
I20260620 22:03:50.873836 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 7670
I20260620 22:03:50.879271 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:37265
--local_ip_for_outbound_sockets=127.1.55.195
--tserver_master_addrs=127.1.55.254:38079
--webserver_port=32929
--webserver_interface=127.1.55.195
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab
--principal=oryx/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:03:50.880465 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.866782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:54291 (local address 127.1.55.253:44805)
0620 22:03:50.866831 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.866833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.867099 (+ 266us) server_negotiation.cc:407] Connection header received
0620 22:03:50.867938 (+ 839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.867940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.867952 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.867983 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.869022 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.869555 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870538 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.870800 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870836 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.873680 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.873681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.873682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.873689 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.879175 (+ 5486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879613 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.879614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.879615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.879681 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879894 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.879895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.879895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.880023 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.880066 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.880285 (+ 219us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.880358 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260620 22:03:50.880496 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.866735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:46133 (local address 127.1.55.252:45675)
0620 22:03:50.866822 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.866824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.867026 (+ 202us) server_negotiation.cc:407] Connection header received
0620 22:03:50.867924 (+ 898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.867926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.867939 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.868004 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.868622 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.869162 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870270 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.870462 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870544 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.872618 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.872619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.872619 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.872625 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.878888 (+ 6263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879407 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.879408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.879408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.879462 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879745 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.879746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.879747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.879882 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.879922 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.880282 (+ 360us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.880369 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260620 22:03:50.880595 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.866949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:43789 (local address 127.1.55.254:38079)
0620 22:03:50.867028 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:50.867030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:50.867039 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:50.867939 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:50.867941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:50.867952 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:50.867983 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:50.869041 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.869683 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870561 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.870822 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870855 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.873114 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:50.873115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:50.873116 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:50.873123 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:50.878949 (+ 5826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879833 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.879834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.879834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.879887 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:50.880081 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:50.880082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:50.880083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:50.880215 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:50.880267 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:50.880449 (+ 182us) server_negotiation.cc:299] Negotiation successful
0620 22:03:50.880516 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260620 22:03:50.880913 8452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.866689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.1.55.194:54291)
0620 22:03:50.867019 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.867027 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.867840 (+ 813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.868063 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.868068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.868389 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.868525 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.868924 (+ 399us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.869637 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.869638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.870443 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.870445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.870915 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.870970 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.871397 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.871400 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.873590 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.879258 (+ 5668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879259 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.879260 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.879529 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.879758 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879758 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.879759 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.879820 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.880113 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.880114 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.880151 (+ 37us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.880569 (+ 418us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.880737 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":181,"thread_start_us":54,"threads_started":1}
I20260620 22:03:50.881006 8453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.866689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45675 (local address 127.1.55.194:46133)
0620 22:03:50.866893 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.866933 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.867816 (+ 883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.868064 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.868067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.868361 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.868524 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.868527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.869273 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.869274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.870174 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.870176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.870554 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.870674 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.871131 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.871139 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.872528 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.879005 (+ 6477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.879013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.879312 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.879529 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879529 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.879530 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.879671 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.879965 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.879970 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.880118 (+ 148us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.880606 (+ 488us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.880852 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":114,"thread_start_us":92,"threads_started":1}
I20260620 22:03:50.881287 8450 heartbeater.cc:347] Connected to a master server at 127.1.55.253:44805
I20260620 22:03:50.881335 8448 heartbeater.cc:347] Connected to a master server at 127.1.55.252:45675
I20260620 22:03:50.881372 8450 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:50.881383 8448 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:50.881572 8450 heartbeater.cc:511] Master 127.1.55.253:44805 requested a full tablet report, sending...
I20260620 22:03:50.881588 8448 heartbeater.cc:511] Master 127.1.55.252:45675 requested a full tablet report, sending...
I20260620 22:03:50.881507 8454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:50.866689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:43789)
0620 22:03:50.866983 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:50.866994 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:50.867840 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:50.868063 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:50.868068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:50.868403 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:50.868943 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.868944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.869778 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.869778 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.870479 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:50.870481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:50.870925 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:50.870926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:50.870970 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:50.871473 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:50.871477 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:50.872961 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:50.879294 (+ 6333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879294 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.879295 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.879750 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.879959 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:50.879960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:50.879960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:50.880008 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:50.880309 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:50.880309 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:50.880340 (+ 31us) client_negotiation.cc:769] Sending connection context
0620 22:03:50.880862 (+ 522us) client_negotiation.cc:240] Negotiation successful
0620 22:03:50.880939 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":6,"thread_start_us":84,"threads_started":1}
I20260620 22:03:50.881989 8449 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38079
I20260620 22:03:50.881999 8132 ts_manager.cc:194] Registered new tserver with Master: 86c7aa64a4424ce1bcfe31ee449b1913 (127.1.55.194:42373)
I20260620 22:03:50.882032 8449 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:50.882090 8449 heartbeater.cc:511] Master 127.1.55.254:38079 requested a full tablet report, sending...
I20260620 22:03:50.882208 7939 ts_manager.cc:194] Registered new tserver with Master: 86c7aa64a4424ce1bcfe31ee449b1913 (127.1.55.194:42373)
I20260620 22:03:50.882282 7337 ts_manager.cc:194] Re-registered known tserver with Master: 86c7aa64a4424ce1bcfe31ee449b1913 (127.1.55.194:42373)
I20260620 22:03:50.882632 7337 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:43789
W20260620 22:03:50.954655 8455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:03:50.954854 8455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:03:50.954923 8455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:03:50.956108 8455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:03:50.956171 8455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:03:50.956216 8455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:03:50.957866 8455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab
--principal=oryx/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:37265
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=32929
--tserver_master_addrs=127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:03:50.958099 8455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:03:50.958318 8455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:03:50.962972 8460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:03:50.962982 8461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.963162 8455 server_base.cc:1034] running on GCE node
W20260620 22:03:50.962996 8463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:03:50.963359 8455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:03:50.963596 8455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:03:50.964766 8455 hybrid_clock.cc:648] HybridClock initialized: now 1781993030964749 us; error 29 us; skew 500 ppm
Jun 20 22:03:50 dist-test-slave-xw35 krb5kdc[7293](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:03:50.967304 8455 init.cc:377] Logged in from keytab as oryx/127.1.55.195@KRBTEST.COM (short username oryx)
I20260620 22:03:50.967753 8455 webserver.cc:460] Webserver started at http://127.1.55.195:32929/ using document root <none> and password file <none>
I20260620 22:03:50.967928 8455 fs_manager.cc:359] Metadata directory not provided
I20260620 22:03:50.967978 8455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:03:50.969125 8455 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:03:50.969623 8470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.969777 8455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:50.969856 8455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "8dcff8158d384fa0a91d3645dd5fd61c"
format_stamp: "Formatted at 2026-06-20 22:03:50 on dist-test-slave-xw35"
server_key: "a1000155a97e3cbf64722cf66b4efb9e"
server_key_iv: "7569ac06dda8a72cb43f6bf34e6f2ec8"
server_key_version: "encryptionkey@0"
I20260620 22:03:50.970105 8455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:03:51.007953 8455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:03:51.010340 8455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:03:51.010485 8455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:03:51.010746 8455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:03:51.011118 8455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:03:51.011184 8455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:51.011224 8455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:03:51.011250 8455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:03:51.017117 8455 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:37265
I20260620 22:03:51.017154 8583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:37265 every 8 connection(s)
I20260620 22:03:51.017452 8455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
Jun 20 22:03:51 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:03:51.025462 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 8455
Jun 20 22:03:51 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.253@KRBTEST.COM
Jun 20 22:03:51 dist-test-slave-xw35 krb5kdc[7293](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993030, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.252@KRBTEST.COM
I20260620 22:03:51.029997 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.018177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:51779 (local address 127.1.55.254:38079)
0620 22:03:51.018274 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.018276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.018769 (+ 493us) server_negotiation.cc:407] Connection header received
0620 22:03:51.019575 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.019576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.019587 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.019618 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.020669 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.021428 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023021 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.023330 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023387 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.025885 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.025886 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.025887 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.025894 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.027939 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.028862 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.028864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.028865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.028923 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.029239 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.029240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.029240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.029365 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.029406 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.029791 (+ 385us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.029876 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260620 22:03:51.031373 7990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.018207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:58253 (local address 127.1.55.253:44805)
0620 22:03:51.018343 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.018345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.018609 (+ 264us) server_negotiation.cc:407] Connection header received
0620 22:03:51.019574 (+ 965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.019576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.019587 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.019624 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.020669 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.021426 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023455 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.023719 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023759 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.026486 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.026488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.026488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.026494 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.029451 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.030605 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.030606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.030607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.030660 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.030867 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.030867 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.030868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.030980 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.031022 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.031217 (+ 195us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.031288 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260620 22:03:51.031817 8590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.018129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:44805 (local address 127.1.55.195:58253)
0620 22:03:51.018471 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:51.018500 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:51.019459 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:51.019778 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:51.019782 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:51.020288 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:51.020564 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.020569 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.021585 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.021586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.022933 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.022935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.023828 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023828 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.023890 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.024238 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:51.024243 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:51.026337 (+ 2094us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:51.030305 (+ 3968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:51.030306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:51.030306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:51.030488 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:51.030736 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:51.030737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:51.030737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:51.030797 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:51.031069 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:51.031070 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:51.031105 (+ 35us) client_negotiation.cc:769] Sending connection context
0620 22:03:51.031458 (+ 353us) client_negotiation.cc:240] Negotiation successful
0620 22:03:51.031613 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":139,"thread_start_us":85,"threads_started":1}
I20260620 22:03:51.032649 8586 heartbeater.cc:347] Connected to a master server at 127.1.55.253:44805
I20260620 22:03:51.032739 8586 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:51.032919 8586 heartbeater.cc:511] Master 127.1.55.253:44805 requested a full tablet report, sending...
I20260620 22:03:51.033377 7939 ts_manager.cc:194] Registered new tserver with Master: 8dcff8158d384fa0a91d3645dd5fd61c (127.1.55.195:37265)
I20260620 22:03:51.033576 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.018227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:58257 (local address 127.1.55.252:45675)
0620 22:03:51.018269 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.018271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.018587 (+ 316us) server_negotiation.cc:407] Connection header received
0620 22:03:51.019576 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.019577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.019591 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.019632 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.020689 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.021465 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023033 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.023329 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023370 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.027116 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.027117 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.027118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.027124 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.030176 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.032799 (+ 2623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.032801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.032801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.032851 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.033062 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.033062 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.033063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.033164 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.033203 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.033368 (+ 165us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.033457 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:03:51.033789 8588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.018128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45675 (local address 127.1.55.195:58257)
0620 22:03:51.018509 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:51.018520 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:51.019465 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:51.019785 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:51.019786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:51.020331 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:51.020566 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.020571 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.021601 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.021601 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.022934 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.022935 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.023440 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.023549 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.024345 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:51.024349 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:51.027018 (+ 2669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:51.032501 (+ 5483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:51.032502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:51.032502 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:51.032696 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:51.032912 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:51.032912 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:51.032912 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:51.032958 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:51.033244 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:51.033245 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:51.033277 (+ 32us) client_negotiation.cc:769] Sending connection context
0620 22:03:51.033394 (+ 117us) client_negotiation.cc:240] Negotiation successful
0620 22:03:51.033477 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"mutex_wait_us":140,"thread_start_us":72,"threads_started":1}
I20260620 22:03:51.034072 8584 heartbeater.cc:347] Connected to a master server at 127.1.55.252:45675
I20260620 22:03:51.034121 8584 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:51.034184 8584 heartbeater.cc:511] Master 127.1.55.252:45675 requested a full tablet report, sending...
I20260620 22:03:51.034432 8132 ts_manager.cc:194] Registered new tserver with Master: 8dcff8158d384fa0a91d3645dd5fd61c (127.1.55.195:37265)
I20260620 22:03:51.036279 8589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.018129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:51779)
0620 22:03:51.018712 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:51.018721 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:51.019467 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:51.019779 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:51.019782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:51.020319 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:03:51.020564 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.020569 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.021585 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.021586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.022935 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.022938 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.023419 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.023420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.023550 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.024086 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:03:51.024096 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:03:51.025759 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:03:51.028426 (+ 2667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:51.028431 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:51.028434 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:51.028758 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:51.029004 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:03:51.029005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:03:51.029006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:03:51.029161 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:03:51.029496 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:03:51.029501 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:03:51.029643 (+ 142us) client_negotiation.cc:769] Sending connection context
0620 22:03:51.034293 (+ 4650us) client_negotiation.cc:240] Negotiation successful
0620 22:03:51.034380 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":327,"thread_start_us":80,"threads_started":1}
I20260620 22:03:51.036921 8595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.027005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58082 (local address 127.1.55.252:45675)
0620 22:03:51.027888 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.027890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.028032 (+ 142us) server_negotiation.cc:407] Connection header received
0620 22:03:51.028051 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.028051 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.028062 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.028535 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.029523 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.030242 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.031351 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.031712 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.031764 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.033339 (+ 1575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.033340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.033340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.033346 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.035657 (+ 2311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.036080 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.036081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.036082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.036138 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.036335 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.036336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.036336 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.036462 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.036549 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.036745 (+ 196us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.036813 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":861,"thread_start_us":51,"threads_started":1}
I20260620 22:03:51.037586 8585 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38079
I20260620 22:03:51.037635 8585 heartbeater.cc:464] Registering TS with master...
I20260620 22:03:51.037696 8585 heartbeater.cc:511] Master 127.1.55.254:38079 requested a full tablet report, sending...
I20260620 22:03:51.037890 7337 ts_manager.cc:194] Re-registered known tserver with Master: 8dcff8158d384fa0a91d3645dd5fd61c (127.1.55.195:37265)
I20260620 22:03:51.038338 7337 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:51779
I20260620 22:03:51.039458 7667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.028122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47270 (local address 127.1.55.254:38079)
0620 22:03:51.030068 (+ 1946us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.030070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.030077 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:03:51.030106 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.030107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.030115 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.030166 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.031078 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.031733 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.033208 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.033462 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.033524 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.035413 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.035414 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.035414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.035421 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.038267 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.038708 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.038709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.038709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.038759 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.038926 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.038927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.038927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.039036 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.039102 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.039291 (+ 189us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.039360 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1933,"thread_start_us":82,"threads_started":1}
I20260620 22:03:51.039880 8596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.027243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52028 (local address 127.1.55.253:44805)
0620 22:03:51.027341 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.027343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.027922 (+ 579us) server_negotiation.cc:407] Connection header received
0620 22:03:51.028027 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.028028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.028043 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.028522 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.029532 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.030251 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.031359 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.031645 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.031683 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.035727 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.035728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.035728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.035735 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.037791 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.039041 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.039042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.039043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.039100 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.039291 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.039292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.039293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.039394 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.039483 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.039716 (+ 233us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.039788 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":58,"threads_started":1}
I20260620 22:03:51.041267 7337 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:03:51.042871 7337 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:03:51.050661 8606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.046317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:37265 (local address 127.0.0.1:51106)
0620 22:03:51.046438 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:51.046447 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:51.046488 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:51.046933 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:51.046933 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:51.046935 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:51.047157 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.047158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.048376 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.048377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.049629 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.049631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.050462 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.050463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.050521 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.050524 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:51.050552 (+ 28us) client_negotiation.cc:240] Negotiation successful
0620 22:03:51.050587 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":39,"thread_start_us":81,"threads_started":1}
I20260620 22:03:51.050734 7898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.046231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:42373 (local address 127.0.0.1:48974)
0620 22:03:51.046265 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:51.046276 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:51.046313 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:51.047025 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:51.047025 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:51.047026 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:51.047052 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.047053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.048280 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.048281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.049419 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.049422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.050560 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.050561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.050616 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.050620 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:03:51.050644 (+ 24us) client_negotiation.cc:240] Negotiation successful
0620 22:03:51.050678 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260620 22:03:51.050940 8608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.046534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40614 (local address 127.1.55.193:39339)
0620 22:03:51.046700 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.046704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.046713 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:03:51.046748 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.046750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.046767 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.046933 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:51.047117 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.048255 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.049704 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.050371 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.050435 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.050498 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.050699 (+ 201us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.050867 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":75,"threads_started":1}
I20260620 22:03:51.050958 8607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.046508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51106 (local address 127.1.55.195:37265)
0620 22:03:51.046668 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.046673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.046683 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:03:51.046715 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.046718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.046839 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.047215 (+ 376us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:51.047250 (+ 35us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.048290 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.049704 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.050371 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.050775 (+ 404us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.050850 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.050871 (+ 21us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.050900 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260620 22:03:51.051529 8605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.046265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:39339 (local address 127.0.0.1:40614)
0620 22:03:51.046390 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:51.046401 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:51.046447 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:51.046991 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:51.046992 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:51.046993 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:51.047028 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.047029 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.048352 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.048353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.049610 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.049613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.050523 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.050523 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.050572 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.050574 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:03:51.050626 (+ 52us) client_negotiation.cc:240] Negotiation successful
0620 22:03:51.050655 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":40,"thread_start_us":80,"threads_started":1}
I20260620 22:03:51.052037 8609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.046713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48974 (local address 127.1.55.194:42373)
0620 22:03:51.046849 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.046853 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.046863 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:03:51.046900 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.046902 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.046918 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.046995 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:51.047145 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.048181 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.049808 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.050471 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.051691 (+ 1220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.051788 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.051855 (+ 67us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.051896 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
I20260620 22:03:51.052099 8518 tablet_service.cc:1467] Processing CreateTablet for tablet ce32a590784e418ea7ad29b23364483a (DEFAULT_TABLE table=test-table [id=eaf9ba6f27424135b34b54d8aebc8692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:51.052405 8518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce32a590784e418ea7ad29b23364483a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:51.052577 8382 tablet_service.cc:1467] Processing CreateTablet for tablet ce32a590784e418ea7ad29b23364483a (DEFAULT_TABLE table=test-table [id=eaf9ba6f27424135b34b54d8aebc8692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:51.052865 8382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce32a590784e418ea7ad29b23364483a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:51.055454 8610 tablet_bootstrap.cc:492] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: Bootstrap starting.
I20260620 22:03:51.056104 8610 tablet_bootstrap.cc:654] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:51.056121 8245 tablet_service.cc:1467] Processing CreateTablet for tablet ce32a590784e418ea7ad29b23364483a (DEFAULT_TABLE table=test-table [id=eaf9ba6f27424135b34b54d8aebc8692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:03:51.056397 8610 log.cc:824] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:51.056443 8245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce32a590784e418ea7ad29b23364483a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:03:51.056457 8611 tablet_bootstrap.cc:492] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Bootstrap starting.
I20260620 22:03:51.057073 8611 tablet_bootstrap.cc:654] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:51.057284 8610 tablet_bootstrap.cc:492] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: No bootstrap required, opened a new log
I20260620 22:03:51.057346 8610 ts_tablet_manager.cc:1397] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:03:51.057436 8611 log.cc:824] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:51.058269 8611 tablet_bootstrap.cc:492] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: No bootstrap required, opened a new log
I20260620 22:03:51.058341 8611 ts_tablet_manager.cc:1397] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 22:03:51.059535 8614 tablet_bootstrap.cc:492] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: Bootstrap starting.
I20260620 22:03:51.060448 8614 tablet_bootstrap.cc:654] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: Neither blocks nor log segments found. Creating new log.
I20260620 22:03:51.060464 8610 raft_consensus.cc:348] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.060642 8610 raft_consensus.cc:374] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:51.060681 8610 raft_consensus.cc:729] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dcff8158d384fa0a91d3645dd5fd61c, State: Initialized, Role: FOLLOWER
I20260620 22:03:51.060760 8614 log.cc:824] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: Log is configured to *not* fsync() on all Append() calls
I20260620 22:03:51.060799 8610 consensus_queue.cc:260] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.061043 8610 ts_tablet_manager.cc:1428] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260620 22:03:51.061236 8585 heartbeater.cc:503] Master 127.1.55.254:38079 was elected leader, sending a full tablet report...
I20260620 22:03:51.061203 8611 raft_consensus.cc:348] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.061381 8611 raft_consensus.cc:374] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:51.061415 8611 raft_consensus.cc:729] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86c7aa64a4424ce1bcfe31ee449b1913, State: Initialized, Role: FOLLOWER
I20260620 22:03:51.061527 8611 consensus_queue.cc:260] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.061759 8611 ts_tablet_manager.cc:1428] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Time spent starting tablet: real 0.003s user 0.002s sys 0.002s
I20260620 22:03:51.062052 8449 heartbeater.cc:503] Master 127.1.55.254:38079 was elected leader, sending a full tablet report...
I20260620 22:03:51.062252 8614 tablet_bootstrap.cc:492] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: No bootstrap required, opened a new log
I20260620 22:03:51.062311 8614 ts_tablet_manager.cc:1397] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 22:03:51.064034 8614 raft_consensus.cc:348] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.064180 8614 raft_consensus.cc:374] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:03:51.064237 8614 raft_consensus.cc:729] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7637e08ae62f424080b476557b0e31b3, State: Initialized, Role: FOLLOWER
I20260620 22:03:51.064342 8614 consensus_queue.cc:260] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.064535 8614 ts_tablet_manager.cc:1428] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:03:51.064764 8312 heartbeater.cc:503] Master 127.1.55.254:38079 was elected leader, sending a full tablet report...
W20260620 22:03:51.117394 8451 tablet.cc:2369] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:03:51.153148 8617 raft_consensus.cc:482] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:03:51.153230 8617 raft_consensus.cc:504] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.153554 8617 leader_election.cc:288] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dcff8158d384fa0a91d3645dd5fd61c (127.1.55.195:37265), 7637e08ae62f424080b476557b0e31b3 (127.1.55.193:39339)
I20260620 22:03:51.156514 8454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.153737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:37265 (local address 127.1.55.194:36801)
0620 22:03:51.153773 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:51.153784 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:51.153823 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:51.154034 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:51.154035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:51.154038 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:51.154107 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.154108 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.154793 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.154794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.155677 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.155679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.156262 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.156263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.156345 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.156348 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:51.156404 (+ 56us) client_negotiation.cc:240] Negotiation successful
0620 22:03:51.156433 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18,"mutex_wait_us":36}
I20260620 22:03:51.156527 8607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.153765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:36801 (local address 127.1.55.195:37265)
0620 22:03:51.153805 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.153808 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.153819 (+ 11us) server_negotiation.cc:407] Connection header received
0620 22:03:51.153917 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.153918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.153931 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.154010 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:51.154194 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.154709 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.155755 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.156181 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.156235 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.156242 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.156418 (+ 176us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.156454 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:03:51.156633 8452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.153737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:39339 (local address 127.1.55.194:41017)
0620 22:03:51.153945 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:51.153955 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:03:51.154013 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:03:51.154191 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:03:51.154192 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:03:51.154193 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:03:51.154247 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.154248 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.154882 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.154883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.155750 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:03:51.155752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.156342 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.156342 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:03:51.156438 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.156441 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:03:51.156498 (+ 57us) client_negotiation.cc:240] Negotiation successful
0620 22:03:51.156532 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":171}
I20260620 22:03:51.156656 8608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.153826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:41017 (local address 127.1.55.193:39339)
0620 22:03:51.153894 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.153895 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.154023 (+ 128us) server_negotiation.cc:407] Connection header received
0620 22:03:51.154084 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.154085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.154096 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.154161 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:03:51.154306 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.154779 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.155877 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.156253 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.156322 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.156330 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.156538 (+ 208us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.156580 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 22:03:51.156797 8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce32a590784e418ea7ad29b23364483a" candidate_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" is_pre_election: true
I20260620 22:03:51.156936 8538 raft_consensus.cc:2454] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c7aa64a4424ce1bcfe31ee449b1913 in term 0.
I20260620 22:03:51.157150 8338 leader_election.cc:302] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86c7aa64a4424ce1bcfe31ee449b1913, 8dcff8158d384fa0a91d3645dd5fd61c; no voters:
I20260620 22:03:51.157243 8265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce32a590784e418ea7ad29b23364483a" candidate_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7637e08ae62f424080b476557b0e31b3" is_pre_election: true
I20260620 22:03:51.157275 8617 raft_consensus.cc:2781] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:03:51.157318 8617 raft_consensus.cc:482] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:03:51.157336 8617 raft_consensus.cc:3037] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:51.157368 8265 raft_consensus.cc:2454] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86c7aa64a4424ce1bcfe31ee449b1913 in term 0.
I20260620 22:03:51.158037 8617 raft_consensus.cc:504] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.158174 8617 leader_election.cc:288] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [CANDIDATE]: Term 1 election: Requested vote from peers 8dcff8158d384fa0a91d3645dd5fd61c (127.1.55.195:37265), 7637e08ae62f424080b476557b0e31b3 (127.1.55.193:39339)
I20260620 22:03:51.158279 8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce32a590784e418ea7ad29b23364483a" candidate_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dcff8158d384fa0a91d3645dd5fd61c"
I20260620 22:03:51.158304 8265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce32a590784e418ea7ad29b23364483a" candidate_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7637e08ae62f424080b476557b0e31b3"
I20260620 22:03:51.158361 8538 raft_consensus.cc:3037] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:51.158387 8265 raft_consensus.cc:3037] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:03:51.158964 8538 raft_consensus.cc:2454] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c7aa64a4424ce1bcfe31ee449b1913 in term 1.
I20260620 22:03:51.159060 8265 raft_consensus.cc:2454] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86c7aa64a4424ce1bcfe31ee449b1913 in term 1.
I20260620 22:03:51.159273 8336 leader_election.cc:302] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7637e08ae62f424080b476557b0e31b3, 86c7aa64a4424ce1bcfe31ee449b1913; no voters:
I20260620 22:03:51.159369 8617 raft_consensus.cc:2781] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:03:51.159523 8617 raft_consensus.cc:686] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 1 LEADER]: Becoming Leader. State: Replica: 86c7aa64a4424ce1bcfe31ee449b1913, State: Running, Role: LEADER
I20260620 22:03:51.159622 8617 consensus_queue.cc:237] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } }
I20260620 22:03:51.160331 7337 catalog_manager.cc:5495] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86c7aa64a4424ce1bcfe31ee449b1913 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86c7aa64a4424ce1bcfe31ee449b1913" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 42373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 } health_report { overall_health: UNKNOWN } } }
I20260620 22:03:51.168776 8609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.166439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48980 (local address 127.1.55.194:42373)
0620 22:03:51.166489 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.166491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.166499 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:03:51.166563 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.166564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.166580 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.166666 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:03:51.166799 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.167232 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.167980 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.168185 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.168274 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.168449 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:03:51.168539 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:03:51.168647 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.168685 (+ 38us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.168701 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 22:03:51.170236 8265 raft_consensus.cc:1261] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 1 FOLLOWER]: Refusing update from remote peer 86c7aa64a4424ce1bcfe31ee449b1913: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:51.170236 8538 raft_consensus.cc:1261] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 1 FOLLOWER]: Refusing update from remote peer 86c7aa64a4424ce1bcfe31ee449b1913: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:03:51.170537 8619 consensus_queue.cc:1035] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7637e08ae62f424080b476557b0e31b3" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 39339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:51.170660 8617 consensus_queue.cc:1035] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dcff8158d384fa0a91d3645dd5fd61c" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:03:51.173130 8623 mvcc.cc:205] Tried to move back new op lower bound from 7299043455670943744 to 7299043455630266368. Current Snapshot: MvccSnapshot[applied={T|T < 7299043455670943744}]
I20260620 22:03:51.175294 7337 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:51.175374 7337 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:03:51.176743 7337 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 488004efac5449d89be8c0f12a26ca72: Sending DeleteTablet for 3 replicas of tablet ce32a590784e418ea7ad29b23364483a
I20260620 22:03:51.177011 8245 tablet_service.cc:1514] Processing DeleteTablet for tablet ce32a590784e418ea7ad29b23364483a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:51 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:40614
I20260620 22:03:51.177006 8382 tablet_service.cc:1514] Processing DeleteTablet for tablet ce32a590784e418ea7ad29b23364483a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:51 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:48974
I20260620 22:03:51.177057 8518 tablet_service.cc:1514] Processing DeleteTablet for tablet ce32a590784e418ea7ad29b23364483a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:03:51 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:51106
I20260620 22:03:51.177241 8632 tablet_replica.cc:330] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: stopping tablet replica
I20260620 22:03:51.177335 8632 raft_consensus.cc:2229] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:03:51.177425 8632 raft_consensus.cc:2258] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:51.177928 8632 ts_tablet_manager.cc:1905] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:51.177975 8634 tablet_replica.cc:330] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: stopping tablet replica
I20260620 22:03:51.178028 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 7306
I20260620 22:03:51.178058 8634 raft_consensus.cc:2229] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:51.178560 8634 raft_consensus.cc:2258] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:51.178709 8633 tablet_replica.cc:330] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: stopping tablet replica
I20260620 22:03:51.178779 8633 raft_consensus.cc:2229] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:03:51.178858 8633 raft_consensus.cc:2258] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:03:51.179284 8633 ts_tablet_manager.cc:1905] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:51.180023 8632 ts_tablet_manager.cc:1918] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:51.180089 8632 log.cc:1196] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/ce32a590784e418ea7ad29b23364483a
I20260620 22:03:51.180382 8632 ts_tablet_manager.cc:1939] T ce32a590784e418ea7ad29b23364483a P 86c7aa64a4424ce1bcfe31ee449b1913: Deleting consensus metadata
I20260620 22:03:51.180898 8633 ts_tablet_manager.cc:1918] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:51.180943 8633 log.cc:1196] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/ce32a590784e418ea7ad29b23364483a
I20260620 22:03:51.181137 8633 ts_tablet_manager.cc:1939] T ce32a590784e418ea7ad29b23364483a P 7637e08ae62f424080b476557b0e31b3: Deleting consensus metadata
W20260620 22:03:51.184126 8201 connection.cc:535] server connection from 127.0.0.1:40614 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 22:03:51.184249 8335 connection.cc:535] server connection from 127.0.0.1:48974 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 22:03:51.189262 8634 ts_tablet_manager.cc:1905] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:03:51.194101 8318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.185778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58094 (local address 127.1.55.252:45675)
0620 22:03:51.185826 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.185828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.185835 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:03:51.185853 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.185854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.185881 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.185935 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.186737 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.187410 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.188352 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.188642 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.188700 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.190387 (+ 1687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.190388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.190388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.190395 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.192813 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.193200 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.193201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.193201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.193250 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.193434 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.193436 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.193436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.193569 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.193666 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.193950 (+ 284us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.194009 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:03:51.194468 8595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.177598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58090 (local address 127.1.55.252:45675)
0620 22:03:51.177644 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.177646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.185953 (+ 8307us) server_negotiation.cc:407] Connection header received
0620 22:03:51.185990 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.185991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.186003 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.186047 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.187418 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.188172 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.189772 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.190063 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.190098 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.191386 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.191387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.191388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.191394 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.193196 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.193644 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.193645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.193645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.193694 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.193868 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.193869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.193869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.194043 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.194112 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.194271 (+ 159us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.194387 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:03:51.194623 8596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:51.185454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52034 (local address 127.1.55.253:44805)
0620 22:03:51.185510 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 22:03:51.185511 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:03:51.185611 (+ 100us) server_negotiation.cc:407] Connection header received
0620 22:03:51.185642 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:03:51.185643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:03:51.185654 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:03:51.185723 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:03:51.186556 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.187299 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.188363 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:03:51.188662 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:03:51.188700 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:03:51.191233 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:03:51.191235 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:03:51.191235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:03:51.191241 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:03:51.193213 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.193675 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.193676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.193676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.193726 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:03:51.193906 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:03:51.193907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:03:51.193907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:03:51.194021 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:03:51.194093 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 22:03:51.194473 (+ 380us) server_negotiation.cc:299] Negotiation successful
0620 22:03:51.194543 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 22:03:51.194919 8634 ts_tablet_manager.cc:1918] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:03:51.194977 8634 log.cc:1196] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/ce32a590784e418ea7ad29b23364483a
I20260620 22:03:51.195210 8634 ts_tablet_manager.cc:1939] T ce32a590784e418ea7ad29b23364483a P 8dcff8158d384fa0a91d3645dd5fd61c: Deleting consensus metadata
W20260620 22:03:51.195577 8472 connection.cc:441] server connection from 127.0.0.1:51106 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51106 (request call id 1) could send its response
I20260620 22:03:52.175486 8643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:52.175209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:45741)
0620 22:03:52.175367 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:52.175434 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":87,"threads_started":1}
I20260620 22:03:52.175488 8644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:52.175168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:55703)
0620 22:03:52.175370 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:52.175440 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":96,"threads_started":1}
W20260620 22:03:52.175689 8312 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:38079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
W20260620 22:03:52.175750 8585 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:38079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:03:52.175828 8645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:52.175565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:41457)
0620 22:03:52.175728 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:52.175789 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":59,"threads_started":1}
W20260620 22:03:52.176074 8449 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:38079 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:03:52.677841 8646 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 488004efac5449d89be8c0f12a26ca72)
I20260620 22:03:52.677974 8646 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:03:52.678221 8646 leader_election.cc:288] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079)
I20260620 22:03:52.678498 8647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:52.678344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:41824)
0620 22:03:52.678420 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:52.678457 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62,"thread_start_us":38,"threads_started":1}
W20260620 22:03:52.678634 7926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:03:52.678989 8647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:52.678871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:41826)
0620 22:03:52.678947 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:52.678971 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260620 22:03:52.679088 7926 leader_election.cc:334] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079): Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:03:52.679153 7926 leader_election.cc:302] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cc1841da354d4b31ad7cf3ab1a7c4bd3; no voters: 488004efac5449d89be8c0f12a26ca72
I20260620 22:03:52.679239 8646 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:03:53.176229 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:53.175954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:48165)
0620 22:03:53.176088 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:53.176131 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":59,"threads_started":1}
I20260620 22:03:53.176311 8650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:53.176091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:47505)
0620 22:03:53.176226 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:53.176260 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260620 22:03:53.176584 8651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:53.176390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:43535)
0620 22:03:53.176510 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:53.176541 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":42,"threads_started":1}
I20260620 22:03:54.176991 8652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:54.176749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:34225)
0620 22:03:54.176890 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:54.176928 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260620 22:03:54.177042 8653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:54.176846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:54671)
0620 22:03:54.176958 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:54.176991 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":52,"threads_started":1}
I20260620 22:03:54.177065 8654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:54.176898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:47899)
0620 22:03:54.176999 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:54.177026 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":43,"threads_started":1}
I20260620 22:03:54.235810 8655 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 488004efac5449d89be8c0f12a26ca72)
I20260620 22:03:54.235885 8655 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:03:54.236027 8655 leader_election.cc:288] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079)
I20260620 22:03:54.236348 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:54.236177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:42070)
0620 22:03:54.236273 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:54.236306 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":57,"threads_started":1}
I20260620 22:03:54.236732 8656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:54.236643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:42074)
0620 22:03:54.236691 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:54.236715 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260620 22:03:54.236819 7926 leader_election.cc:334] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079): Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:03:54.236871 7926 leader_election.cc:302] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cc1841da354d4b31ad7cf3ab1a7c4bd3; no voters: 488004efac5449d89be8c0f12a26ca72
I20260620 22:03:54.236948 8655 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:03:55.177628 8659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:55.177411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:45133)
0620 22:03:55.177543 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:55.177577 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":52,"threads_started":1}
I20260620 22:03:55.177639 8660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:55.177424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:40399)
0620 22:03:55.177543 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:55.177577 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":41,"threads_started":1}
I20260620 22:03:55.177644 8658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:55.177389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:36689)
0620 22:03:55.177552 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:55.177583 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":71,"threads_started":1}
I20260620 22:03:56.178261 8662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:56.178059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:50641)
0620 22:03:56.178179 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:56.178213 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":49,"threads_started":1}
I20260620 22:03:56.178262 8661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:56.178015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:47989)
0620 22:03:56.178165 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:56.178204 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260620 22:03:56.178433 8663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:56.178220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:43397)
0620 22:03:56.178319 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:56.178388 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":60,"threads_started":1}
I20260620 22:03:56.421288 8664 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 488004efac5449d89be8c0f12a26ca72)
I20260620 22:03:56.421416 8664 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:03:56.421645 8664 leader_election.cc:288] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079)
I20260620 22:03:56.421932 8665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:56.421772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:42280)
0620 22:03:56.421860 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:56.421897 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":41,"threads_started":1}
I20260620 22:03:56.422331 8665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:56.422221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:42284)
0620 22:03:56.422285 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:56.422312 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260620 22:03:56.422418 7926 leader_election.cc:334] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079): Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:03:56.422497 7926 leader_election.cc:302] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cc1841da354d4b31ad7cf3ab1a7c4bd3; no voters: 488004efac5449d89be8c0f12a26ca72
I20260620 22:03:56.422585 8664 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:03:57.178867 8667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:57.178667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:59833)
0620 22:03:57.178791 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:57.178824 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260620 22:03:57.178910 8668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:57.178741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:53063)
0620 22:03:57.178831 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:57.178862 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74,"thread_start_us":54,"threads_started":1}
I20260620 22:03:57.179080 8669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:57.178891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:33669)
0620 22:03:57.179017 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:57.179044 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":40,"threads_started":1}
I20260620 22:03:58.179464 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:58.179273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:34847)
0620 22:03:58.179377 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:58.179414 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":59,"threads_started":1}
I20260620 22:03:58.179464 8671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:58.179307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:33575)
0620 22:03:58.179400 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:58.179427 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":47,"threads_started":1}
I20260620 22:03:58.179569 8672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:58.179366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:49001)
0620 22:03:58.179443 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:58.179472 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61,"thread_start_us":39,"threads_started":1}
I20260620 22:03:59.180047 8673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:59.179850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:34037)
0620 22:03:59.179961 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:59.179996 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":67,"threads_started":1}
I20260620 22:03:59.180047 8675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:59.179847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:58523)
0620 22:03:59.179984 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:59.180011 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":58,"threads_started":1}
I20260620 22:03:59.180231 8674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:03:59.179847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:53261)
0620 22:03:59.180165 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0620 22:03:59.180194 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":57,"threads_started":1}
I20260620 22:04:00.180624 8676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:00.180420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:57881)
0620 22:04:00.180540 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:00.180575 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
I20260620 22:04:00.180644 8677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:00.180414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:57131)
0620 22:04:00.180557 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:00.180592 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
I20260620 22:04:00.180752 8678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:00.180582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:34253)
0620 22:04:00.180683 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:00.180711 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":53,"threads_started":1}
I20260620 22:04:00.233240 8679 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 488004efac5449d89be8c0f12a26ca72)
I20260620 22:04:00.233310 8679 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:04:00.233414 8679 leader_election.cc:288] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079)
I20260620 22:04:00.233697 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:00.233534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:42606)
0620 22:04:00.233629 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:00.233662 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":48,"threads_started":1}
W20260620 22:04:00.233778 7926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260620 22:04:00.234088 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:00.234011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:42612)
0620 22:04:00.234052 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:00.234074 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260620 22:04:00.234160 7926 leader_election.cc:334] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079): Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:04:00.234210 7926 leader_election.cc:302] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cc1841da354d4b31ad7cf3ab1a7c4bd3; no voters: 488004efac5449d89be8c0f12a26ca72
I20260620 22:04:00.234287 8679 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:04:01.181386 8682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:01.181114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:48837)
0620 22:04:01.181289 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:01.181340 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":105,"threads_started":1}
I20260620 22:04:01.181386 8684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:01.181181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:58005)
0620 22:04:01.181287 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:01.181323 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":57,"threads_started":1}
I20260620 22:04:01.181386 8683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:01.181169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:45873)
0620 22:04:01.181297 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:01.181338 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
I20260620 22:04:02.181963 8685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:02.181759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:34489)
0620 22:04:02.181878 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:02.181912 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260620 22:04:02.181963 8686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:02.181793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:44809)
0620 22:04:02.181904 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:02.181925 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":45,"threads_started":1}
I20260620 22:04:02.181995 8687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:02.181814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:60031)
0620 22:04:02.181931 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:02.181959 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":62,"threads_started":1}
I20260620 22:04:03.182503 8688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:03.182319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:54063)
0620 22:04:03.182421 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:03.182454 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":60,"threads_started":1}
I20260620 22:04:03.182535 8689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:03.182352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:57827)
0620 22:04:03.182457 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:03.182489 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":53,"threads_started":1}
I20260620 22:04:03.182556 8690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:03.182394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:38015)
0620 22:04:03.182481 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:03.182504 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73,"thread_start_us":40,"threads_started":1}
I20260620 22:04:04.183097 8691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:04.182899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:43027)
0620 22:04:04.183020 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:04.183055 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
I20260620 22:04:04.183110 8692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:04.182898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:60147)
0620 22:04:04.183038 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:04.183073 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260620 22:04:04.183293 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:04.182898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:55551)
0620 22:04:04.183224 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:04.183254 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":73,"threads_started":1}
I20260620 22:04:05.183730 8695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:05.183499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:53587)
0620 22:04:05.183636 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:05.183681 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260620 22:04:05.183729 8694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:05.183499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:34067)
0620 22:04:05.183625 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:05.183666 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
I20260620 22:04:05.183872 8696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:05.183661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:53897)
0620 22:04:05.183754 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:05.183789 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":52,"threads_started":1}
I20260620 22:04:06.184370 8697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:06.184160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:34651)
0620 22:04:06.184290 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:06.184331 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260620 22:04:06.184370 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:06.184164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:41859)
0620 22:04:06.184288 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:06.184323 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260620 22:04:06.184370 8699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:06.184172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:37227)
0620 22:04:06.184288 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:06.184323 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":68,"threads_started":1}
I20260620 22:04:06.911355 8700 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 488004efac5449d89be8c0f12a26ca72)
I20260620 22:04:06.911445 8700 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:04:06.911602 8700 leader_election.cc:288] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079)
I20260620 22:04:06.911921 8701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:06.911735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:57232)
0620 22:04:06.911834 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:06.911887 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":60,"threads_started":1}
W20260620 22:04:06.911995 7926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:04:06.912328 8701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:06.912242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:57248)
0620 22:04:06.912287 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:06.912311 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260620 22:04:06.912393 7926 leader_election.cc:334] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079): Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:04:06.912456 7926 leader_election.cc:302] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cc1841da354d4b31ad7cf3ab1a7c4bd3; no voters: 488004efac5449d89be8c0f12a26ca72
I20260620 22:04:06.912535 8700 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:04:07.184929 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:07.184726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:46941)
0620 22:04:07.184844 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:07.184886 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":54,"threads_started":1}
I20260620 22:04:07.184959 8704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:07.184753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:35325)
0620 22:04:07.184869 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:07.184905 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":68,"threads_started":1}
I20260620 22:04:07.185150 8705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:07.184902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:40745)
0620 22:04:07.185086 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:07.185115 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":56,"threads_started":1}
I20260620 22:04:08.185520 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:08.185267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:49773)
0620 22:04:08.185386 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:08.185441 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":71,"threads_started":1}
I20260620 22:04:08.185552 8707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:08.185335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:45101)
0620 22:04:08.185448 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:08.185506 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":54,"threads_started":1}
I20260620 22:04:08.185726 8708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:08.185520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:59467)
0620 22:04:08.185652 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:08.185682 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":53,"threads_started":1}
I20260620 22:04:09.186093 8709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:09.185884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:51189)
0620 22:04:09.185993 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:09.186040 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":59,"threads_started":1}
I20260620 22:04:09.186091 8710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:09.185927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:50901)
0620 22:04:09.186005 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:09.186054 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63,"thread_start_us":40,"threads_started":1}
I20260620 22:04:09.186240 8711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:09.186054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:49053)
0620 22:04:09.186175 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:09.186207 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
I20260620 22:04:10.186667 8712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:10.186437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:50653)
0620 22:04:10.186580 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:10.186624 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260620 22:04:10.186673 8713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:10.186463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:50377)
0620 22:04:10.186581 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:10.186623 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":68,"threads_started":1}
I20260620 22:04:10.186728 8714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:10.186576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:41117)
0620 22:04:10.186664 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:10.186689 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":43,"threads_started":1}
I20260620 22:04:11.187254 8715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:11.187029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:49495)
0620 22:04:11.187160 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:11.187195 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":56,"threads_started":1}
I20260620 22:04:11.187279 8716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:11.187030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:60675)
0620 22:04:11.187184 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:11.187216 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":55,"threads_started":1}
I20260620 22:04:11.187363 8717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:11.187186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:60575)
0620 22:04:11.187293 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:11.187324 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":46,"threads_started":1}
I20260620 22:04:12.187973 8718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:12.187737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:41097)
0620 22:04:12.187896 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:12.187929 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260620 22:04:12.187976 8719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:12.187744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:58105)
0620 22:04:12.187903 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:12.187931 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
I20260620 22:04:12.187976 8720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:12.187800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:42721)
0620 22:04:12.187892 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:12.187930 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74,"thread_start_us":40,"threads_started":1}
I20260620 22:04:12.783017 8721 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 488004efac5449d89be8c0f12a26ca72)
I20260620 22:04:12.783124 8721 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "488004efac5449d89be8c0f12a26ca72" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38079 } } peers { permanent_uuid: "cc1841da354d4b31ad7cf3ab1a7c4bd3" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 44805 } attrs { promote: false } } peers { permanent_uuid: "f5fbf2da6bc24e91894cf813a13aa0cf" member_type: NON_VOTER last_known_addr { host: "127.1.55.252" port: 45675 } attrs { promote: true } }
I20260620 22:04:12.783277 8721 leader_election.cc:288] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079)
I20260620 22:04:12.783555 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:12.783396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:39586)
0620 22:04:12.783479 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:12.783517 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67,"thread_start_us":48,"threads_started":1}
W20260620 22:04:12.783627 7926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:04:12.783931 8722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:12.783844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.0.0.1:39600)
0620 22:04:12.783890 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:12.783913 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260620 22:04:12.784001 7926 leader_election.cc:334] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 488004efac5449d89be8c0f12a26ca72 (127.1.55.254:38079): Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
I20260620 22:04:12.784049 7926 leader_election.cc:302] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: cc1841da354d4b31ad7cf3ab1a7c4bd3; no voters: 488004efac5449d89be8c0f12a26ca72
I20260620 22:04:12.784121 8721 raft_consensus.cc:2726] T 00000000000000000000000000000000 P cc1841da354d4b31ad7cf3ab1a7c4bd3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:04:13.188609 8724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:13.188384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:52749)
0620 22:04:13.188517 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:13.188558 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260620 22:04:13.188601 8726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:13.188390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:36355)
0620 22:04:13.188514 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:13.188548 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":88,"threads_started":1}
I20260620 22:04:13.188601 8725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:13.188384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:39413)
0620 22:04:13.188511 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:13.188548 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260620 22:04:14.189273 8727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:14.188983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:51055)
0620 22:04:14.189141 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:14.189196 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
I20260620 22:04:14.189332 8729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:14.189128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:36119)
0620 22:04:14.189252 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:14.189286 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":41,"threads_started":1}
I20260620 22:04:14.189380 8728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:14.188983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:35003)
0620 22:04:14.189295 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:14.189322 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":76,"threads_started":1}
I20260620 22:04:15.189934 8730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:15.189652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:45645)
0620 22:04:15.189838 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:15.189879 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":60,"threads_started":1}
I20260620 22:04:15.190132 8732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:15.189916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:53061)
0620 22:04:15.190050 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:15.190091 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":47,"threads_started":1}
I20260620 22:04:15.190150 8731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:15.189738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:37203)
0620 22:04:15.190064 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:15.190097 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":48,"threads_started":1}
I20260620 22:04:16.190718 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:16.190319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:60111)
0620 22:04:16.190623 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:16.190657 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":63,"threads_started":1}
I20260620 22:04:16.190757 8734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:16.190444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:58527)
0620 22:04:16.190695 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:16.190721 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":42,"threads_started":1}
I20260620 22:04:16.190757 8735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:16.190577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:60939)
0620 22:04:16.190675 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:16.190712 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":42,"threads_started":1}
I20260620 22:04:17.191388 8737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:17.191169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:55501)
0620 22:04:17.191300 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:17.191336 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260620 22:04:17.191401 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:17.191169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:54313)
0620 22:04:17.191298 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:17.191331 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260620 22:04:17.191550 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:17.191294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:34471)
0620 22:04:17.191410 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:17.191440 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
I20260620 22:04:18.192034 8739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:18.191766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:55555)
0620 22:04:18.191927 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:18.191966 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":57,"threads_started":1}
I20260620 22:04:18.192045 8740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:18.191833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:46625)
0620 22:04:18.191949 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:18.191987 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":53,"threads_started":1}
I20260620 22:04:18.192242 8741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:18.192023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:60417)
0620 22:04:18.192172 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:18.192204 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":55,"threads_started":1}
I20260620 22:04:19.192706 8742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:19.192476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:53959)
0620 22:04:19.192614 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:19.192646 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":60,"threads_started":1}
I20260620 22:04:19.192816 8744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:19.192659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:43523)
0620 22:04:19.192751 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:19.192776 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":39,"threads_started":1}
I20260620 22:04:19.192821 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:19.192627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:48447)
0620 22:04:19.192738 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:19.192772 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":69,"threads_started":1}
I20260620 22:04:20.193477 8745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:20.193213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:60669)
0620 22:04:20.193366 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:20.193406 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":64,"threads_started":1}
I20260620 22:04:20.193602 8746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:20.193234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:39747)
0620 22:04:20.193505 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:20.193552 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":58,"threads_started":1}
I20260620 22:04:20.193638 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:20.193234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:46907)
0620 22:04:20.193538 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:20.193588 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":54,"threads_started":1}
I20260620 22:04:21.194204 8748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:21.193955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.193:34397)
0620 22:04:21.194132 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:21.194162 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":66,"threads_started":1}
I20260620 22:04:21.194294 8750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:21.194075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.194:45039)
0620 22:04:21.194169 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:21.194199 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":56,"threads_started":1}
I20260620 22:04:21.194432 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:21.194067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38079 (local address 127.1.55.195:43015)
0620 22:04:21.194276 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:21.194393 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38079: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":49,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675, num_attempts: 243) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.1.55.254:38079,127.1.55.253:44805,127.1.55.252:45675, num_attempts: 1)
I20260620 22:04:21.336679 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 8086
I20260620 22:04:21.341302 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 8319
I20260620 22:04:21.346035 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 8455
I20260620 22:04:21.350226 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 7804
I20260620 22:04:21.354067 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 7993
2026-06-20T22:04:21Z chronyd exiting
I20260620 22:04:21.369449 1247 test_util.cc:175] -----------------------------------------------
I20260620 22:04:21.369679 1247 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781993001979103-1247-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (36817 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:04:21 dist-test-slave-xw35 krb5kdc[8753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:04:21 dist-test-slave-xw35 krb5kdc[8753](info): set up 2 sockets
Jun 20 22:04:21 dist-test-slave-xw35 krb5kdc[8753](info): commencing operation
krb5kdc: starting...
W20260620 22:04:22.321802 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.951s user 0.002s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:04:22 dist-test-slave-xw35 krb5kdc[8753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:04:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:04:22Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.254.keytab.
Entry for principal oryx/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.254.keytab.
I20260620 22:04:22.424181 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:33309
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.254.keytab
--principal=oryx/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:33309
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:22.497319 8766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:22.497521 8766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:22.497555 8766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:22.498515 8766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:04:22.498569 8766 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260620 22:04:22.498587 8766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:22.498607 8766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:22.498634 8766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:04:22.498652 8766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:04:22.500083 8766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:33309
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.254.keytab
--principal=oryx/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:33309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:22.500309 8766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:22.500494 8766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:04:22.504762 8766 server_base.cc:1034] running on GCE node
W20260620 22:04:22.504774 8771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:22.504806 8774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:22.504802 8772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:22.505240 8766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:22.505460 8766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:22.506670 8766 hybrid_clock.cc:648] HybridClock initialized: now 1781993062506658 us; error 28 us; skew 500 ppm
Jun 20 22:04:22 dist-test-slave-xw35 krb5kdc[8753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:22.509083 8766 init.cc:377] Logged in from keytab as oryx/127.1.55.254@KRBTEST.COM (short username oryx)
I20260620 22:04:22.509521 8766 webserver.cc:460] Webserver started at http://127.1.55.254:40665/ using document root <none> and password file <none>
I20260620 22:04:22.509703 8766 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:22.509744 8766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:22.509824 8766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:22.510699 8766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "73718cd468c64708bf16901551a19a4b"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "9f6de1b2ebc7e755c6c4ac035abf6b27"
server_key_iv: "e7c40e79195120627a579a8eb6c2320a"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.510995 8766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "73718cd468c64708bf16901551a19a4b"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "9f6de1b2ebc7e755c6c4ac035abf6b27"
server_key_iv: "e7c40e79195120627a579a8eb6c2320a"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.512162 8766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:04:22.512799 8781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.512964 8766 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.513046 8766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "73718cd468c64708bf16901551a19a4b"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "9f6de1b2ebc7e755c6c4ac035abf6b27"
server_key_iv: "e7c40e79195120627a579a8eb6c2320a"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.513096 8766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:22.518575 8766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:22.520185 8766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:22.520275 8766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:22.524156 8766 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:33309
I20260620 22:04:22.524250 8843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:33309 every 8 connection(s)
I20260620 22:04:22.524529 8766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:04:22.525092 8844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:22.526954 8844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: Bootstrap starting.
I20260620 22:04:22.527371 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 8766
I20260620 22:04:22.527482 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:04:22.527577 8844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:22.527701 1247 external_mini_cluster.cc:1428] Setting key b547cb98c1edcd7fecee86297095410d
I20260620 22:04:22.528007 8844 log.cc:824] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:22.528755 8844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: No bootstrap required, opened a new log
I20260620 22:04:22.530611 8844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73718cd468c64708bf16901551a19a4b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33309 } }
I20260620 22:04:22.530759 8844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:22.530790 8844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73718cd468c64708bf16901551a19a4b, State: Initialized, Role: FOLLOWER
I20260620 22:04:22.530892 8844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73718cd468c64708bf16901551a19a4b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33309 } }
I20260620 22:04:22.530956 8844 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:04:22.530982 8844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:04:22.531034 8844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:22.531574 8844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73718cd468c64708bf16901551a19a4b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33309 } }
I20260620 22:04:22.531664 8844 leader_election.cc:302] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73718cd468c64708bf16901551a19a4b; no voters:
I20260620 22:04:22.531809 8844 leader_election.cc:288] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:04:22.531836 8849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:22.531935 8849 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [term 1 LEADER]: Becoming Leader. State: Replica: 73718cd468c64708bf16901551a19a4b, State: Running, Role: LEADER
I20260620 22:04:22.532021 8844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:04:22.532011 8849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73718cd468c64708bf16901551a19a4b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33309 } }
I20260620 22:04:22.532421 8850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73718cd468c64708bf16901551a19a4b. Latest consensus state: current_term: 1 leader_uuid: "73718cd468c64708bf16901551a19a4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73718cd468c64708bf16901551a19a4b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33309 } } }
I20260620 22:04:22.533188 8850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:22.533260 8851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73718cd468c64708bf16901551a19a4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73718cd468c64708bf16901551a19a4b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33309 } } }
I20260620 22:04:22.533422 8851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:22.533463 8863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:04:22.534832 8863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 20 22:04:22 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:04:22.536504 8863 catalog_manager.cc:1347] Generated new cluster ID: 34613b1fc54a499f9c6f5b300bf82fe2
I20260620 22:04:22.536549 8863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:04:22.539930 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.528269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52762 (local address 127.1.55.254:33309)
0620 22:04:22.528428 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:22.528435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:22.528481 (+ 46us) server_negotiation.cc:407] Connection header received
0620 22:04:22.529025 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:22.529033 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:22.529089 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:22.529230 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:22.529860 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.531465 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.532519 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.532901 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.533014 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.535528 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:22.535532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:22.535532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:22.535542 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:22.538341 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.538766 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.538769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.538769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.538872 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.539101 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.539102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.539102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.539357 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:22.539485 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:22.539630 (+ 145us) server_negotiation.cc:299] Negotiation successful
0620 22:04:22.539751 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260620 22:04:22.546919 8863 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:04:22.547376 8863 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:04:22.550417 8863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: Generated new TSK 0
I20260620 22:04:22.550581 8863 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab.
Entry for principal oryx/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab.
I20260620 22:04:22.579655 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33309
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab
--principal=oryx/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:22.655828 8870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:22.656021 8870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:22.656044 8870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:22.657160 8870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:22.657199 8870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:22.657219 8870 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:04:22.657272 8870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:04:22.658744 8870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab
--principal=oryx/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:33309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:22.658985 8870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:22.659194 8870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:22.663738 8875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:22.663771 8876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:22.663743 8878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:22.663930 8870 server_base.cc:1034] running on GCE node
I20260620 22:04:22.664129 8870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:22.664347 8870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:22.665516 8870 hybrid_clock.cc:648] HybridClock initialized: now 1781993062665504 us; error 29 us; skew 500 ppm
Jun 20 22:04:22 dist-test-slave-xw35 krb5kdc[8753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:22.667806 8870 init.cc:377] Logged in from keytab as oryx/127.1.55.193@KRBTEST.COM (short username oryx)
I20260620 22:04:22.668210 8870 webserver.cc:460] Webserver started at http://127.1.55.193:36451/ using document root <none> and password file <none>
I20260620 22:04:22.668432 8870 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:22.668498 8870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:22.668644 8870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:22.669656 8870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "abd61dd786d84685b9ed6e5850abd07a"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "cab0705315e1ee84e8a836af6aea6366"
server_key_iv: "c32448c054d2a94f608d2002ef2c4424"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.669998 8870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "abd61dd786d84685b9ed6e5850abd07a"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "cab0705315e1ee84e8a836af6aea6366"
server_key_iv: "c32448c054d2a94f608d2002ef2c4424"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.671196 8870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:22.671857 8885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.672008 8870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:22.672101 8870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "abd61dd786d84685b9ed6e5850abd07a"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "cab0705315e1ee84e8a836af6aea6366"
server_key_iv: "c32448c054d2a94f608d2002ef2c4424"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.672174 8870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:22.689076 8870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:22.691247 8870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:22.691396 8870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:22.691828 8870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:22.691882 8870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.691911 8870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:22.691936 8870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.698313 8870 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:34453
Jun 20 22:04:22 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:04:22.698374 9000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:34453 every 8 connection(s)
I20260620 22:04:22.698714 8870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:04:22.701445 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.692258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:51429 (local address 127.1.55.254:33309)
0620 22:04:22.692329 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:22.692332 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:22.692457 (+ 125us) server_negotiation.cc:407] Connection header received
0620 22:04:22.692869 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:22.692870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:22.692884 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:22.692959 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:22.693726 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.694483 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.695868 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.696207 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.696284 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.698911 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:22.698913 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:22.698914 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:22.698922 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:22.700365 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.700727 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.700727 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.700728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.700771 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.700955 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.700955 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.700955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.701061 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:22.701126 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:22.701323 (+ 197us) server_negotiation.cc:299] Negotiation successful
0620 22:04:22.701390 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260620 22:04:22.701687 8894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.692219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33309 (local address 127.1.55.193:51429)
0620 22:04:22.692342 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:22.692376 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:22.692782 (+ 406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:22.693025 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:22.693028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:22.693324 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:22.693629 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:22.693636 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.694583 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.694584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:22.695778 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:22.695781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.696305 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.696307 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:22.696453 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.696995 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:22.697003 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:22.698803 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:22.700431 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:22.700435 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:22.700437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:22.700652 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:22.700822 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:22.700822 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:22.700823 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:22.700905 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:22.701130 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:22.701134 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:22.701222 (+ 88us) client_negotiation.cc:769] Sending connection context
0620 22:04:22.701314 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 22:04:22.701443 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":69,"threads_started":1}
I20260620 22:04:22.702167 9001 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33309
I20260620 22:04:22.702248 9001 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:22.702443 9001 heartbeater.cc:511] Master 127.1.55.254:33309 requested a full tablet report, sending...
I20260620 22:04:22.702903 8798 ts_manager.cc:194] Registered new tserver with Master: abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453)
I20260620 22:04:22.703613 8798 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:51429
I20260620 22:04:22.704125 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 8870
I20260620 22:04:22.704219 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:04:22.704373 1247 external_mini_cluster.cc:1428] Setting key e09a5a793fcbc4aec2821c8540c0494c
I20260620 22:04:22.709000 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.703200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:46901 (local address 127.1.55.254:33309)
0620 22:04:22.703234 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:22.703236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:22.703359 (+ 123us) server_negotiation.cc:407] Connection header received
0620 22:04:22.703428 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:22.703428 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:22.703437 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:22.703510 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:22.703816 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.704454 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.705336 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.705565 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.705615 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.706523 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:22.706524 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:22.706525 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:22.706532 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:22.707878 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.708298 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.708299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.708299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.708353 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.708566 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.708567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.708567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.708656 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:22.708706 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:22.708891 (+ 185us) server_negotiation.cc:299] Negotiation successful
0620 22:04:22.708948 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:04:22.709167 9007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.703150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33309 (local address 127.1.55.193:46901)
0620 22:04:22.703294 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:22.703302 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:22.703372 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:22.703513 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:22.703513 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:22.703659 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:22.703735 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:22.703737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.704561 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.704562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:22.705260 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:22.705263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.705629 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.705630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:22.705698 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.706039 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:22.706044 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:22.706434 (+ 390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:22.707956 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:22.707957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:22.707958 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:22.708180 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:22.708429 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:22.708430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:22.708430 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:22.708499 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:22.708723 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:22.708724 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:22.708787 (+ 63us) client_negotiation.cc:769] Sending connection context
0620 22:04:22.708872 (+ 85us) client_negotiation.cc:240] Negotiation successful
0620 22:04:22.708980 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
WARNING: no policy specified for oryx/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab.
Entry for principal oryx/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab.
I20260620 22:04:22.728561 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33309
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab
--principal=oryx/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:22.802479 9010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:22.802678 9010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:22.802701 9010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:22.803838 9010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:22.803876 9010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:22.803895 9010 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:04:22.803938 9010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:04:22.805307 9010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab
--principal=oryx/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:33309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:22.805531 9010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:22.805724 9010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:22.810168 9015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:22.810174 9016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:22.810174 9018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:22.810420 9010 server_base.cc:1034] running on GCE node
I20260620 22:04:22.810647 9010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:22.810892 9010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:22.812052 9010 hybrid_clock.cc:648] HybridClock initialized: now 1781993062812051 us; error 35 us; skew 500 ppm
Jun 20 22:04:22 dist-test-slave-xw35 krb5kdc[8753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:22.814206 9010 init.cc:377] Logged in from keytab as oryx/127.1.55.194@KRBTEST.COM (short username oryx)
I20260620 22:04:22.814627 9010 webserver.cc:460] Webserver started at http://127.1.55.194:38475/ using document root <none> and password file <none>
I20260620 22:04:22.814834 9010 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:22.814895 9010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:22.815047 9010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:22.815990 9010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "0d61d4839879439193e12d714d9b0c07"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "3962a27beda5a5f14ffef0168d1d8701"
server_key_iv: "09fb72724e2fd0e1fc2fd966e4f3e8eb"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.816294 9010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "0d61d4839879439193e12d714d9b0c07"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "3962a27beda5a5f14ffef0168d1d8701"
server_key_iv: "09fb72724e2fd0e1fc2fd966e4f3e8eb"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.817457 9010 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:04:22.818176 9025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.818351 9010 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:22.818434 9010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "0d61d4839879439193e12d714d9b0c07"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "3962a27beda5a5f14ffef0168d1d8701"
server_key_iv: "09fb72724e2fd0e1fc2fd966e4f3e8eb"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.818514 9010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:22.835834 9010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:22.837368 9010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:22.837535 9010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:22.838008 9010 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:22.838050 9010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.838078 9010 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:22.838094 9010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 20 22:04:22 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:04:22.844635 9010 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:41425
I20260620 22:04:22.844722 9140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:41425 every 8 connection(s)
I20260620 22:04:22.845047 9010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:04:22.847227 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.838316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:34465 (local address 127.1.55.254:33309)
0620 22:04:22.838385 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:22.838388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:22.838609 (+ 221us) server_negotiation.cc:407] Connection header received
0620 22:04:22.839011 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:22.839012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:22.839025 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:22.839106 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:22.839678 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.840471 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.841634 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.841959 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.842033 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.844432 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:22.844434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:22.844434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:22.844441 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:22.845955 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.846342 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.846343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.846344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.846407 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.846647 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.846648 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.846649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.846770 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:22.846840 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:22.847076 (+ 236us) server_negotiation.cc:299] Negotiation successful
0620 22:04:22.847145 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 22:04:22.847375 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.838310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33309 (local address 127.1.55.194:34465)
0620 22:04:22.838475 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:22.838510 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:22.838925 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:22.839149 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:22.839152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:22.839362 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:22.839605 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:22.839609 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.840593 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.840594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:22.841574 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:22.841576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.842107 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.842108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:22.842215 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.842682 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:22.842691 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:22.844337 (+ 1646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:22.846055 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:22.846061 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:22.846063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:22.846265 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:22.846472 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:22.846473 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:22.846473 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:22.846579 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:22.846832 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:22.846837 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:22.846959 (+ 122us) client_negotiation.cc:769] Sending connection context
0620 22:04:22.847055 (+ 96us) client_negotiation.cc:240] Negotiation successful
0620 22:04:22.847185 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260620 22:04:22.847843 9141 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33309
I20260620 22:04:22.847921 9141 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:22.848089 9141 heartbeater.cc:511] Master 127.1.55.254:33309 requested a full tablet report, sending...
I20260620 22:04:22.848482 8797 ts_manager.cc:194] Registered new tserver with Master: 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425)
I20260620 22:04:22.849009 8797 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:34465
I20260620 22:04:22.852303 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 9010
I20260620 22:04:22.852416 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:04:22.852619 1247 external_mini_cluster.cc:1428] Setting key 13488851c78f8fdb65d4da3ca737ad2b
I20260620 22:04:22.853729 9147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.848747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33309 (local address 127.1.55.194:50417)
0620 22:04:22.848858 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:22.848867 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:22.848913 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:22.849020 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:22.849020 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:22.849217 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:22.849307 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:22.849309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.849963 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.849963 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:22.850406 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:22.850407 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.850698 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.850699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:22.850738 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.851154 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:22.851159 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:22.851407 (+ 248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:22.852756 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:22.852757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:22.852758 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:22.852947 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:22.853120 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:22.853120 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:22.853121 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:22.853176 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:22.853511 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:22.853511 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:22.853550 (+ 39us) client_negotiation.cc:769] Sending connection context
0620 22:04:22.853609 (+ 59us) client_negotiation.cc:240] Negotiation successful
0620 22:04:22.853672 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":59,"threads_started":1}
I20260620 22:04:22.853835 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:22.848805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:50417 (local address 127.1.55.254:33309)
0620 22:04:22.848835 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:22.848837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:22.848910 (+ 73us) server_negotiation.cc:407] Connection header received
0620 22:04:22.848963 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:22.848964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:22.848970 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:22.849016 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:22.849379 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.849870 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.850480 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:22.850642 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:22.850687 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:22.851467 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:22.851468 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:22.851468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:22.851472 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:22.852682 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.853006 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.853007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.853007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.853056 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:22.853228 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:22.853228 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:22.853228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:22.853415 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:22.853504 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:22.853655 (+ 151us) server_negotiation.cc:299] Negotiation successful
0620 22:04:22.853722 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
WARNING: no policy specified for oryx/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab.
Entry for principal oryx/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab.
I20260620 22:04:22.874045 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33309
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab
--principal=oryx/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:22.947218 9150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:22.947419 9150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:22.947528 9150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:22.948778 9150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:22.948835 9150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:22.948869 9150 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260620 22:04:22.948920 9150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:04:22.950340 9150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab
--principal=oryx/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.55.254:33309
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:22.950572 9150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:22.950795 9150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:22.955212 9155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:22.955257 9150 server_base.cc:1034] running on GCE node
W20260620 22:04:22.955363 9156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:22.955530 9158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:22.955804 9150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:22.956089 9150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:22.957242 9150 hybrid_clock.cc:648] HybridClock initialized: now 1781993062957225 us; error 26 us; skew 500 ppm
Jun 20 22:04:22 dist-test-slave-xw35 krb5kdc[8753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:22.959543 9150 init.cc:377] Logged in from keytab as oryx/127.1.55.195@KRBTEST.COM (short username oryx)
I20260620 22:04:22.959893 9150 webserver.cc:460] Webserver started at http://127.1.55.195:45983/ using document root <none> and password file <none>
I20260620 22:04:22.960083 9150 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:22.960120 9150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:22.960201 9150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:22.961081 9150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "769982e92f784b7cbcf0f23c4cc7b5ee"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "01a7ac45201570c85b884d2c0a8fa309"
server_key_iv: "24a71885ef8eca373328e15631f28a3a"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.961349 9150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "769982e92f784b7cbcf0f23c4cc7b5ee"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "01a7ac45201570c85b884d2c0a8fa309"
server_key_iv: "24a71885ef8eca373328e15631f28a3a"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.962544 9150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:22.963171 9165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.963311 9150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:22.963385 9150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "769982e92f784b7cbcf0f23c4cc7b5ee"
format_stamp: "Formatted at 2026-06-20 22:04:22 on dist-test-slave-xw35"
server_key: "01a7ac45201570c85b884d2c0a8fa309"
server_key_iv: "24a71885ef8eca373328e15631f28a3a"
server_key_version: "encryptionkey@0"
I20260620 22:04:22.963433 9150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:23.000650 9150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:23.002722 9150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:23.002817 9150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:23.003186 9150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:23.003217 9150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.003262 9150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:23.003288 9150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.009814 9150 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:46639
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:04:23.009899 9280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:46639 every 8 connection(s)
I20260620 22:04:23.010190 9150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:04:23.012678 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.003636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:49009 (local address 127.1.55.254:33309)
0620 22:04:23.003695 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.003696 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.003871 (+ 175us) server_negotiation.cc:407] Connection header received
0620 22:04:23.004331 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.004332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.004344 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.004408 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:23.005253 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.005986 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.007477 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.007822 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.007886 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.010418 (+ 2532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:23.010420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:23.010420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:23.010426 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:23.011651 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.011987 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.011987 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.011988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.012032 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.012213 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.012214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.012214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.012299 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:23.012345 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.012564 (+ 219us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.012619 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:04:23.012820 9174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.003617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33309 (local address 127.1.55.195:49009)
0620 22:04:23.003756 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.003792 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.004225 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.004509 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.004514 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.004870 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:23.005151 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.005158 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.006072 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.006073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.007384 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.007386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.007922 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.007924 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.008073 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.008646 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:23.008667 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:23.010331 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:23.011717 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:23.011722 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:23.011723 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:23.011921 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:23.012086 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:23.012086 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:23.012086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:23.012166 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:23.012352 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:23.012356 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:23.012449 (+ 93us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.012524 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.012627 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":78,"threads_started":1}
I20260620 22:04:23.013425 9281 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33309
I20260620 22:04:23.013525 9281 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:23.013708 9281 heartbeater.cc:511] Master 127.1.55.254:33309 requested a full tablet report, sending...
I20260620 22:04:23.014086 8797 ts_manager.cc:194] Registered new tserver with Master: 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639)
I20260620 22:04:23.014560 8797 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:49009
I20260620 22:04:23.017979 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 9150
I20260620 22:04:23.018118 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:04:23.018318 1247 external_mini_cluster.cc:1428] Setting key 2b8d866f0a3f5ae271a2670620a58923
I20260620 22:04:23.019192 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:04:23.020421 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.014400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:51571 (local address 127.1.55.254:33309)
0620 22:04:23.014439 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.014441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.014503 (+ 62us) server_negotiation.cc:407] Connection header received
0620 22:04:23.014563 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.014564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.014572 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.014617 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:23.015330 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.015944 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.016590 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.016819 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.016875 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.017748 (+ 873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:23.017749 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:23.017750 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:23.017759 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:23.019346 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.019690 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.019690 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.019691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.019744 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.019947 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.019947 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.019948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.020049 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:23.020127 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.020265 (+ 138us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.020325 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:04:23.020437 9287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.014344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33309 (local address 127.1.55.195:51571)
0620 22:04:23.014458 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.014466 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.014514 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.014619 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.014620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.014818 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:23.015245 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.015247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.016042 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.016042 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.016507 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.016508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.016893 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.016894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.016940 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.017230 (+ 290us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:23.017235 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:23.017638 (+ 403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:23.019434 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:23.019435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:23.019436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:23.019609 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:23.019816 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:23.019817 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:23.019817 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:23.019887 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:23.020122 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:23.020123 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:23.020162 (+ 39us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.020241 (+ 79us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.020327 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993063, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
W20260620 22:04:23.038905 8848 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:23.034014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52778 (local address 127.1.55.254:33309)
0620 22:04:23.034073 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.034074 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.034101 (+ 27us) server_negotiation.cc:407] Connection header received
0620 22:04:23.034180 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.034181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.034190 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.034260 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:23.034790 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.035248 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.035959 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.036139 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.036217 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.038838 (+ 2621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52778: BlockingRecv error: recv got EOF from 127.0.0.1:52778 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993063, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:04:23.045701 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.039758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52784 (local address 127.1.55.254:33309)
0620 22:04:23.039807 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.039809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.039878 (+ 69us) server_negotiation.cc:407] Connection header received
0620 22:04:23.039952 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.039953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.039960 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.040034 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:23.040466 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.040876 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.041452 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.041693 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.041738 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.043695 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:23.043696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:23.043696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:23.043702 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:23.044794 (+ 1092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.045088 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.045089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.045089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.045132 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.045285 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.045286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.045286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.045366 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:23.045430 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.045601 (+ 171us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.045652 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 22:04:23.047026 8797 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:04:23.048657 8797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:04:23.054499 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.050792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36862 (local address 127.1.55.195:46639)
0620 22:04:23.050943 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.050947 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.051181 (+ 234us) server_negotiation.cc:407] Connection header received
0620 22:04:23.051222 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.051224 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.051237 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.051300 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:23.051482 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.052410 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.053372 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.054074 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.054126 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.054184 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.054396 (+ 212us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.054424 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260620 22:04:23.054719 9300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.050657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:34453 (local address 127.0.0.1:56286)
0620 22:04:23.050954 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.050992 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.051055 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.051264 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.051267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.051269 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:23.051322 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.051323 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.052461 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.052462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.053768 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.053770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.054403 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.054404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.054470 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.054475 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.054523 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.054638 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":39,"thread_start_us":56,"threads_started":1}
I20260620 22:04:23.054733 9302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.050659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:46639 (local address 127.0.0.1:36862)
0620 22:04:23.051107 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.051117 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.051174 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.051352 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.051352 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.051355 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:23.051404 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.051405 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.052489 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.052490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.053286 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.053288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.054236 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.054237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.054305 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.054314 (+ 9us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.054569 (+ 255us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.054641 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":75,"thread_start_us":53,"threads_started":1}
I20260620 22:04:23.055151 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.050946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56286 (local address 127.1.55.193:34453)
0620 22:04:23.051102 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.051104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.051112 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:04:23.051143 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.051144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.051173 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.051265 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:23.051399 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.052390 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.053843 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.054307 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.054399 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.054470 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.054693 (+ 223us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.054740 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
I20260620 22:04:23.055349 9215 tablet_service.cc:1467] Processing CreateTablet for tablet ac874717bc5145d3840cf446bf5925b2 (DEFAULT_TABLE table=test-table [id=2118dc10e2744cda868a5d84ffdd7f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.055663 9215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac874717bc5145d3840cf446bf5925b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.055819 9301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.050672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41425 (local address 127.0.0.1:53704)
0620 22:04:23.051149 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.051157 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.051201 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.052490 (+ 1289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.052490 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.052492 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:23.052526 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.052527 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.053701 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.053702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.054664 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.054667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.055578 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.055578 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.055664 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.055669 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.055718 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.055762 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":2,"thread_start_us":49,"threads_started":1}
I20260620 22:04:23.055727 8935 tablet_service.cc:1467] Processing CreateTablet for tablet ac874717bc5145d3840cf446bf5925b2 (DEFAULT_TABLE table=test-table [id=2118dc10e2744cda868a5d84ffdd7f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.056036 9304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.050883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53704 (local address 127.1.55.194:41425)
0620 22:04:23.051017 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.051020 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.051257 (+ 237us) server_negotiation.cc:407] Connection header received
0620 22:04:23.051297 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.051299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.051315 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.051386 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:23.052606 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.053636 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.054744 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.055420 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.055484 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.055546 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.055909 (+ 363us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.055946 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260620 22:04:23.056067 8935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac874717bc5145d3840cf446bf5925b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.058352 9306 tablet_bootstrap.cc:492] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: Bootstrap starting.
I20260620 22:04:23.058943 9307 tablet_bootstrap.cc:492] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: Bootstrap starting.
I20260620 22:04:23.059158 9306 tablet_bootstrap.cc:654] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.059433 9306 log.cc:824] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:23.059536 9307 tablet_bootstrap.cc:654] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.059515 9075 tablet_service.cc:1467] Processing CreateTablet for tablet ac874717bc5145d3840cf446bf5925b2 (DEFAULT_TABLE table=test-table [id=2118dc10e2744cda868a5d84ffdd7f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.059839 9075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac874717bc5145d3840cf446bf5925b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.059856 9307 log.cc:824] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:23.060174 9306 tablet_bootstrap.cc:492] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: No bootstrap required, opened a new log
I20260620 22:04:23.060243 9306 ts_tablet_manager.cc:1397] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:04:23.060570 9307 tablet_bootstrap.cc:492] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: No bootstrap required, opened a new log
I20260620 22:04:23.060662 9307 ts_tablet_manager.cc:1397] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:04:23.061661 9306 raft_consensus.cc:348] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.061772 9306 raft_consensus.cc:374] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.061792 9306 raft_consensus.cc:729] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769982e92f784b7cbcf0f23c4cc7b5ee, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.062105 9306 consensus_queue.cc:260] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.062371 9306 ts_tablet_manager.cc:1428] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:04:23.062500 9281 heartbeater.cc:503] Master 127.1.55.254:33309 was elected leader, sending a full tablet report...
I20260620 22:04:23.062975 9307 raft_consensus.cc:348] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.063104 9307 raft_consensus.cc:374] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.063133 9307 raft_consensus.cc:729] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd61dd786d84685b9ed6e5850abd07a, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.063261 9307 consensus_queue.cc:260] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.063324 9311 tablet_bootstrap.cc:492] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Bootstrap starting.
I20260620 22:04:23.063491 9307 ts_tablet_manager.cc:1428] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 22:04:23.063596 9001 heartbeater.cc:503] Master 127.1.55.254:33309 was elected leader, sending a full tablet report...
I20260620 22:04:23.063957 9311 tablet_bootstrap.cc:654] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.064286 9311 log.cc:824] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:23.065028 9311 tablet_bootstrap.cc:492] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: No bootstrap required, opened a new log
I20260620 22:04:23.065078 9311 ts_tablet_manager.cc:1397] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:04:23.066738 9311 raft_consensus.cc:348] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.066862 9311 raft_consensus.cc:374] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.066881 9311 raft_consensus.cc:729] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d61d4839879439193e12d714d9b0c07, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.067009 9311 consensus_queue.cc:260] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.067236 9311 ts_tablet_manager.cc:1428] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:04:23.067276 9141 heartbeater.cc:503] Master 127.1.55.254:33309 was elected leader, sending a full tablet report...
W20260620 22:04:23.095574 9142 tablet.cc:2369] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:04:23.131588 9314 raft_consensus.cc:482] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:04:23.131673 9314 raft_consensus.cc:504] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.132102 9314 leader_election.cc:288] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639), abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453)
I20260620 22:04:23.135462 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.132308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:42929 (local address 127.1.55.195:46639)
0620 22:04:23.132344 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.132346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.132356 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:04:23.132386 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.132386 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.132395 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.132456 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:23.132636 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.133319 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.134654 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.135143 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.135205 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.135212 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.135372 (+ 160us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.135403 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:04:23.135462 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.132314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:36621 (local address 127.1.55.193:34453)
0620 22:04:23.132367 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.132369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.132491 (+ 122us) server_negotiation.cc:407] Connection header received
0620 22:04:23.132516 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.132517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.132533 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.132570 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:23.132715 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.133361 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.134653 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.135136 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.135205 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.135212 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.135372 (+ 160us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.135403 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:04:23.135479 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.132250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:46639 (local address 127.1.55.194:42929)
0620 22:04:23.132295 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.132306 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.132344 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.132472 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.132473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.132475 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:23.132540 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.132543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.133387 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.133401 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.134571 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.134574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.135217 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.135217 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.135294 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.135298 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.135350 (+ 52us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.135394 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":33}
I20260620 22:04:23.135490 9315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.132250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:34453 (local address 127.1.55.194:36621)
0620 22:04:23.132406 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.132418 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.132480 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.132589 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.132590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.132607 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:23.132661 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.132663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.133422 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.133423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.134571 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.134574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.135217 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.135217 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.135294 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.135298 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.135350 (+ 52us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.135394 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":52,"thread_start_us":81,"threads_started":1}
I20260620 22:04:23.135802 9232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac874717bc5145d3840cf446bf5925b2" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" is_pre_election: true
I20260620 22:04:23.135908 9232 raft_consensus.cc:2454] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 0.
I20260620 22:04:23.135917 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac874717bc5145d3840cf446bf5925b2" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a" is_pre_election: true
I20260620 22:04:23.136051 8955 raft_consensus.cc:2454] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 0.
I20260620 22:04:23.136204 9029 leader_election.cc:302] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, 769982e92f784b7cbcf0f23c4cc7b5ee; no voters:
I20260620 22:04:23.136353 9314 raft_consensus.cc:2781] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:04:23.136411 9314 raft_consensus.cc:482] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:04:23.136433 9314 raft_consensus.cc:3037] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.137217 9314 raft_consensus.cc:504] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.137331 9314 leader_election.cc:288] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 election: Requested vote from peers 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639), abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453)
I20260620 22:04:23.137451 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac874717bc5145d3840cf446bf5925b2" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a"
I20260620 22:04:23.137439 9232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac874717bc5145d3840cf446bf5925b2" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee"
I20260620 22:04:23.137539 8955 raft_consensus.cc:3037] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.137553 9232 raft_consensus.cc:3037] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.138123 8955 raft_consensus.cc:2454] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 1.
I20260620 22:04:23.138202 9232 raft_consensus.cc:2454] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 1.
I20260620 22:04:23.138271 9028 leader_election.cc:302] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, abd61dd786d84685b9ed6e5850abd07a; no voters:
I20260620 22:04:23.138343 9314 raft_consensus.cc:2781] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:23.138460 9314 raft_consensus.cc:686] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 1 LEADER]: Becoming Leader. State: Replica: 0d61d4839879439193e12d714d9b0c07, State: Running, Role: LEADER
I20260620 22:04:23.138550 9314 consensus_queue.cc:237] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } }
I20260620 22:04:23.139293 8797 catalog_manager.cc:5495] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d61d4839879439193e12d714d9b0c07 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "0d61d4839879439193e12d714d9b0c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } health_report { overall_health: HEALTHY } } }
I20260620 22:04:23.143916 9304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.142201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53706 (local address 127.1.55.194:41425)
0620 22:04:23.142231 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.142233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.142240 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:23.142291 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.142291 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.142303 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.142357 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:04:23.142432 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.142810 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.143411 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.143558 (+ 147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.143606 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.143713 (+ 107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.143786 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.143835 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.143865 (+ 30us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.143879 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:04:23.145164 8955 raft_consensus.cc:1261] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Refusing update from remote peer 0d61d4839879439193e12d714d9b0c07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.145212 9232 raft_consensus.cc:1261] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Refusing update from remote peer 0d61d4839879439193e12d714d9b0c07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.145439 9316 consensus_queue.cc:1035] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.145576 9314 consensus_queue.cc:1035] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.147408 9319 mvcc.cc:205] Tried to move back new op lower bound from 7299043586640736256 to 7299043586615971840. Current Snapshot: MvccSnapshot[applied={T|T < 7299043586640736256}]
I20260620 22:04:23.147679 9320 mvcc.cc:205] Tried to move back new op lower bound from 7299043586640736256 to 7299043586615971840. Current Snapshot: MvccSnapshot[applied={T|T < 7299043586640736256}]
I20260620 22:04:23.149590 8798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:23.149675 8798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:23.150348 8798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: Sending DeleteTablet for 3 replicas of tablet ac874717bc5145d3840cf446bf5925b2
I20260620 22:04:23.150643 9075 tablet_service.cc:1514] Processing DeleteTablet for tablet ac874717bc5145d3840cf446bf5925b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:53704
I20260620 22:04:23.150637 9215 tablet_service.cc:1514] Processing DeleteTablet for tablet ac874717bc5145d3840cf446bf5925b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36862
I20260620 22:04:23.150638 8935 tablet_service.cc:1514] Processing DeleteTablet for tablet ac874717bc5145d3840cf446bf5925b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:56286
I20260620 22:04:23.150906 9331 tablet_replica.cc:330] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: stopping tablet replica
I20260620 22:04:23.150907 9329 tablet_replica.cc:330] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: stopping tablet replica
I20260620 22:04:23.150993 9331 raft_consensus.cc:2229] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:23.151063 8798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52784:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:04:23.151216 8798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:04:23.151353 9331 raft_consensus.cc:2258] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.151499 9330 tablet_replica.cc:330] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: stopping tablet replica
I20260620 22:04:23.151575 9330 raft_consensus.cc:2229] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:04:23.151676 9330 raft_consensus.cc:2258] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.152052 9330 ts_tablet_manager.cc:1905] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.152292 9075 tablet_service.cc:1467] Processing CreateTablet for tablet 5928823e0ae94ffa92a588ed83ab9bf7 (DEFAULT_TABLE table=test-table [id=1e502d0df650444ab6d3a7c8ba7c8333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.152386 9075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5928823e0ae94ffa92a588ed83ab9bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.153858 9311 tablet_bootstrap.cc:492] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: Bootstrap starting.
I20260620 22:04:23.153880 9330 ts_tablet_manager.cc:1918] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:04:23.153934 9330 log.cc:1196] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/ac874717bc5145d3840cf446bf5925b2
I20260620 22:04:23.154080 9215 tablet_service.cc:1467] Processing CreateTablet for tablet 5928823e0ae94ffa92a588ed83ab9bf7 (DEFAULT_TABLE table=test-table [id=1e502d0df650444ab6d3a7c8ba7c8333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.154172 9215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5928823e0ae94ffa92a588ed83ab9bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.154196 9330 ts_tablet_manager.cc:1939] T ac874717bc5145d3840cf446bf5925b2 P 0d61d4839879439193e12d714d9b0c07: Deleting consensus metadata
I20260620 22:04:23.154259 9311 tablet_bootstrap.cc:654] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.154794 9311 tablet_bootstrap.cc:492] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: No bootstrap required, opened a new log
I20260620 22:04:23.154843 9311 ts_tablet_manager.cc:1397] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:23.154955 9311 raft_consensus.cc:348] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.155025 9311 raft_consensus.cc:374] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.155045 9311 raft_consensus.cc:729] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d61d4839879439193e12d714d9b0c07, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.155093 9311 consensus_queue.cc:260] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.155170 9311 ts_tablet_manager.cc:1428] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.155318 9306 tablet_bootstrap.cc:492] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: Bootstrap starting.
I20260620 22:04:23.155400 8783 catalog_manager.cc:4841] TS 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425): tablet ac874717bc5145d3840cf446bf5925b2 (table test-table [id=2118dc10e2744cda868a5d84ffdd7f1d]) successfully deleted
I20260620 22:04:23.151562 9329 raft_consensus.cc:2229] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:23.155650 9329 raft_consensus.cc:2258] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.155727 9306 tablet_bootstrap.cc:654] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.155712 8935 tablet_service.cc:1467] Processing CreateTablet for tablet 5928823e0ae94ffa92a588ed83ab9bf7 (DEFAULT_TABLE table=test-table [id=1e502d0df650444ab6d3a7c8ba7c8333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.155809 8935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5928823e0ae94ffa92a588ed83ab9bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.155920 9331 ts_tablet_manager.cc:1905] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.156960 9331 ts_tablet_manager.cc:1918] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:04:23.157033 9331 log.cc:1196] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/ac874717bc5145d3840cf446bf5925b2
I20260620 22:04:23.157234 9307 tablet_bootstrap.cc:492] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: Bootstrap starting.
I20260620 22:04:23.157289 9331 ts_tablet_manager.cc:1939] T ac874717bc5145d3840cf446bf5925b2 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting consensus metadata
I20260620 22:04:23.157618 9329 ts_tablet_manager.cc:1905] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.157647 9307 tablet_bootstrap.cc:654] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.157637 8785 catalog_manager.cc:4841] TS 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639): tablet ac874717bc5145d3840cf446bf5925b2 (table test-table [id=2118dc10e2744cda868a5d84ffdd7f1d]) successfully deleted
I20260620 22:04:23.158145 9307 tablet_bootstrap.cc:492] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: No bootstrap required, opened a new log
I20260620 22:04:23.158201 9307 ts_tablet_manager.cc:1397] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:23.158336 9307 raft_consensus.cc:348] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.158398 9307 raft_consensus.cc:374] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.158423 9307 raft_consensus.cc:729] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd61dd786d84685b9ed6e5850abd07a, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.158461 9307 consensus_queue.cc:260] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.158535 9307 ts_tablet_manager.cc:1428] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:23.158931 9329 ts_tablet_manager.cc:1918] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:04:23.158995 9329 log.cc:1196] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/ac874717bc5145d3840cf446bf5925b2
I20260620 22:04:23.159238 9329 ts_tablet_manager.cc:1939] T ac874717bc5145d3840cf446bf5925b2 P abd61dd786d84685b9ed6e5850abd07a: Deleting consensus metadata
I20260620 22:04:23.159576 8784 catalog_manager.cc:4841] TS abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453): tablet ac874717bc5145d3840cf446bf5925b2 (table test-table [id=2118dc10e2744cda868a5d84ffdd7f1d]) successfully deleted
I20260620 22:04:23.161844 9306 tablet_bootstrap.cc:492] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: No bootstrap required, opened a new log
I20260620 22:04:23.161892 9306 ts_tablet_manager.cc:1397] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260620 22:04:23.162034 9306 raft_consensus.cc:348] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.162102 9306 raft_consensus.cc:374] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.162122 9306 raft_consensus.cc:729] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769982e92f784b7cbcf0f23c4cc7b5ee, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.162160 9306 consensus_queue.cc:260] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.162240 9306 ts_tablet_manager.cc:1428] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260620 22:04:23.199400 9002 tablet.cc:2369] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:04:23.261031 9282 tablet.cc:2369] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:04:23.383975 9324 raft_consensus.cc:482] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:04:23.384089 9324 raft_consensus.cc:504] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.384268 9324 leader_election.cc:288] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453), 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639)
I20260620 22:04:23.384472 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5928823e0ae94ffa92a588ed83ab9bf7" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a" is_pre_election: true
I20260620 22:04:23.384503 9232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5928823e0ae94ffa92a588ed83ab9bf7" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" is_pre_election: true
I20260620 22:04:23.384578 9232 raft_consensus.cc:2454] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 0.
I20260620 22:04:23.384584 8955 raft_consensus.cc:2454] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 0.
I20260620 22:04:23.384733 9028 leader_election.cc:302] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, abd61dd786d84685b9ed6e5850abd07a; no voters:
I20260620 22:04:23.384829 9324 raft_consensus.cc:2781] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:04:23.384865 9324 raft_consensus.cc:482] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:04:23.384889 9324 raft_consensus.cc:3037] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.385514 9324 raft_consensus.cc:504] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.385635 9324 leader_election.cc:288] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 election: Requested vote from peers abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453), 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639)
I20260620 22:04:23.385777 9232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5928823e0ae94ffa92a588ed83ab9bf7" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee"
I20260620 22:04:23.385794 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5928823e0ae94ffa92a588ed83ab9bf7" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a"
I20260620 22:04:23.385851 8955 raft_consensus.cc:3037] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.385851 9232 raft_consensus.cc:3037] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.386548 9232 raft_consensus.cc:2454] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 1.
I20260620 22:04:23.386575 8955 raft_consensus.cc:2454] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 1.
I20260620 22:04:23.386714 9028 leader_election.cc:302] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, abd61dd786d84685b9ed6e5850abd07a; no voters:
I20260620 22:04:23.386826 9324 raft_consensus.cc:2781] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:23.386869 9324 raft_consensus.cc:686] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 1 LEADER]: Becoming Leader. State: Replica: 0d61d4839879439193e12d714d9b0c07, State: Running, Role: LEADER
I20260620 22:04:23.386943 9324 consensus_queue.cc:237] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.387429 8798 catalog_manager.cc:5495] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d61d4839879439193e12d714d9b0c07 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "0d61d4839879439193e12d714d9b0c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } health_report { overall_health: UNKNOWN } } }
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993062, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.254@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:04:23.460258 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.454125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52790 (local address 127.1.55.254:33309)
0620 22:04:23.454214 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.454216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.454294 (+ 78us) server_negotiation.cc:407] Connection header received
0620 22:04:23.454359 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.454360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.454369 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.454414 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:23.454797 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.455232 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.455848 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.456043 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.456116 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.458030 (+ 1914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:23.458031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:23.458031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:23.458037 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:23.459381 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.459693 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.459693 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.459694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.459739 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.459905 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.459905 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.459906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.459992 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:23.460037 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.460145 (+ 108us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.460202 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260620 22:04:23.460409 9341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.454037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33309 (local address 127.0.0.1:52790)
0620 22:04:23.454219 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.454229 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.454305 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.454417 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.454417 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.454684 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:23.454720 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.454722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.455306 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.455307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.455772 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.455773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.456112 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.456113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.456161 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.456633 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:23.456637 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:23.457940 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:23.459449 (+ 1509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:23.459454 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:23.459456 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:23.459632 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:23.459794 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:23.459795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:23.459795 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:23.459843 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:23.460040 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:23.460044 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:23.460083 (+ 39us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.460131 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.460264 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":54,"thread_start_us":80,"threads_started":1}
I20260620 22:04:23.462579 8798 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:52790:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260620 22:04:23.462774 8798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:04:23.466436 9075 tablet_service.cc:1467] Processing CreateTablet for tablet 70e2e35aa8a34c5bb0c9a000cb854e38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4ccee329718144aebc0b97822bd1de68]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:04:23.466567 8935 tablet_service.cc:1467] Processing CreateTablet for tablet 70e2e35aa8a34c5bb0c9a000cb854e38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4ccee329718144aebc0b97822bd1de68]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:04:23.466607 9075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e2e35aa8a34c5bb0c9a000cb854e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.466622 9215 tablet_service.cc:1467] Processing CreateTablet for tablet 70e2e35aa8a34c5bb0c9a000cb854e38 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4ccee329718144aebc0b97822bd1de68]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260620 22:04:23.466681 8935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e2e35aa8a34c5bb0c9a000cb854e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.466753 9215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70e2e35aa8a34c5bb0c9a000cb854e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.468346 9307 tablet_bootstrap.cc:492] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: Bootstrap starting.
I20260620 22:04:23.468663 9306 tablet_bootstrap.cc:492] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: Bootstrap starting.
I20260620 22:04:23.468946 9307 tablet_bootstrap.cc:654] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.469125 9306 tablet_bootstrap.cc:654] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.469429 9311 tablet_bootstrap.cc:492] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: Bootstrap starting.
I20260620 22:04:23.469568 9307 tablet_bootstrap.cc:492] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: No bootstrap required, opened a new log
I20260620 22:04:23.469619 9307 ts_tablet_manager.cc:1397] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:23.469794 9311 tablet_bootstrap.cc:654] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.469763 9307 raft_consensus.cc:348] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.469843 9307 raft_consensus.cc:374] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.469866 9307 raft_consensus.cc:729] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd61dd786d84685b9ed6e5850abd07a, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.469933 9307 consensus_queue.cc:260] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.470028 9307 ts_tablet_manager.cc:1428] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260620 22:04:23.470276 9312 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.470359 9312 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:04:23.470422 9306 tablet_bootstrap.cc:492] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: No bootstrap required, opened a new log
I20260620 22:04:23.470464 9306 ts_tablet_manager.cc:1397] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:04:23.470603 9306 raft_consensus.cc:348] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.470670 9306 raft_consensus.cc:374] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.470692 9306 raft_consensus.cc:729] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769982e92f784b7cbcf0f23c4cc7b5ee, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.470741 9306 consensus_queue.cc:260] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.470839 9306 ts_tablet_manager.cc:1428] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.470927 9311 tablet_bootstrap.cc:492] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: No bootstrap required, opened a new log
I20260620 22:04:23.470965 9311 ts_tablet_manager.cc:1397] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 22:04:23.470904 9310 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.471004 9310 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:04:23.471071 9311 raft_consensus.cc:348] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.471140 9311 raft_consensus.cc:374] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.471169 9311 raft_consensus.cc:729] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d61d4839879439193e12d714d9b0c07, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.471211 9311 consensus_queue.cc:260] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.471302 9311 ts_tablet_manager.cc:1428] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.471395 9324 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.471454 9324 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:04:23.473132 9310 raft_consensus.cc:482] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:04:23.473189 9310 raft_consensus.cc:504] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.473497 9310 leader_election.cc:288] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453), 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425)
I20260620 22:04:23.477372 9174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.473629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41425 (local address 127.1.55.195:52363)
0620 22:04:23.473715 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.473726 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.473763 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.473894 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.473895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.473896 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:23.473961 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.473963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.474943 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.474944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.476379 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.476382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.477147 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.477148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.477216 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.477219 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.477270 (+ 51us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.477306 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260620 22:04:23.477380 9304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.473722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:52363 (local address 127.1.55.194:41425)
0620 22:04:23.473762 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.473764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.473774 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:04:23.473807 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.473808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.473818 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.473883 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:23.474048 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.474869 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.476464 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.477019 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.477099 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.477109 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.477274 (+ 165us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.477309 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:04:23.477726 9095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e2e35aa8a34c5bb0c9a000cb854e38" candidate_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d61d4839879439193e12d714d9b0c07" is_pre_election: true
I20260620 22:04:23.477849 9095 raft_consensus.cc:2454] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769982e92f784b7cbcf0f23c4cc7b5ee in term 0.
I20260620 22:04:23.478020 9167 leader_election.cc:302] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, 769982e92f784b7cbcf0f23c4cc7b5ee; no voters:
I20260620 22:04:23.478170 9310 raft_consensus.cc:2781] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:04:23.478238 9310 raft_consensus.cc:482] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:04:23.478260 9310 raft_consensus.cc:3037] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.479127 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.473874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:36041 (local address 127.1.55.193:34453)
0620 22:04:23.473913 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.473915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.474000 (+ 85us) server_negotiation.cc:407] Connection header received
0620 22:04:23.474081 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.474082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.474091 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.474150 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:23.474557 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.475188 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.478201 (+ 3013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.478774 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.478866 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.478874 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.479054 (+ 180us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.479086 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:04:23.479166 9345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.473629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:34453 (local address 127.1.55.195:36041)
0620 22:04:23.473941 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.473952 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.474028 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.474164 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.474165 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.474167 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:23.474233 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.474237 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.476568 (+ 2331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.476569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.477983 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.477986 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.478882 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.478883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.478962 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.478966 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.479042 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.479077 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":12,"thread_start_us":47,"threads_started":1}
I20260620 22:04:23.479368 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e2e35aa8a34c5bb0c9a000cb854e38" candidate_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a" is_pre_election: true
I20260620 22:04:23.479435 8955 raft_consensus.cc:2454] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769982e92f784b7cbcf0f23c4cc7b5ee in term 0.
I20260620 22:04:23.479436 9310 raft_consensus.cc:504] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.479575 9310 leader_election.cc:288] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [CANDIDATE]: Term 1 election: Requested vote from peers abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453), 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425)
I20260620 22:04:23.479687 9095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e2e35aa8a34c5bb0c9a000cb854e38" candidate_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d61d4839879439193e12d714d9b0c07"
I20260620 22:04:23.479681 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70e2e35aa8a34c5bb0c9a000cb854e38" candidate_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a"
I20260620 22:04:23.479750 9095 raft_consensus.cc:3037] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.479746 8955 raft_consensus.cc:3037] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.480446 9095 raft_consensus.cc:2454] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 769982e92f784b7cbcf0f23c4cc7b5ee in term 1.
I20260620 22:04:23.480532 8955 raft_consensus.cc:2454] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 769982e92f784b7cbcf0f23c4cc7b5ee in term 1.
I20260620 22:04:23.480583 9167 leader_election.cc:302] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, 769982e92f784b7cbcf0f23c4cc7b5ee; no voters:
I20260620 22:04:23.480757 9310 raft_consensus.cc:2781] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:23.480878 9310 raft_consensus.cc:686] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 LEADER]: Becoming Leader. State: Replica: 769982e92f784b7cbcf0f23c4cc7b5ee, State: Running, Role: LEADER
I20260620 22:04:23.480963 9310 consensus_queue.cc:237] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.481236 9346 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: TxnStatusTablet state changed. Reason: New leader 769982e92f784b7cbcf0f23c4cc7b5ee. Latest consensus state: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.481323 9346 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:04:23.481701 9348 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260620 22:04:23.481802 9348 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260620 22:04:23.481856 8798 catalog_manager.cc:5495] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195). New cstate: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } health_report { overall_health: HEALTHY } } }
I20260620 22:04:23.494338 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.489450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36868 (local address 127.1.55.195:46639)
0620 22:04:23.489531 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.489533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.489541 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:04:23.489568 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.489569 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.489585 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.489659 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:04:23.489809 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.490486 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.493545 (+ 3059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.493723 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.493808 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.493998 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.494133 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.494193 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.494264 (+ 71us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.494282 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260620 22:04:23.494377 9341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.489316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:46639 (local address 127.0.0.1:36868)
0620 22:04:23.489384 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.489395 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.489443 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.489684 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.489685 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.489687 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:04:23.489733 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.489735 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.490574 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.490575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.491383 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.491385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.493810 (+ 2425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.493811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.493876 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.493893 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.494202 (+ 309us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.494210 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.494259 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.494303 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260620 22:04:23.498425 8955 raft_consensus.cc:1261] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Refusing update from remote peer 769982e92f784b7cbcf0f23c4cc7b5ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.498483 9095 raft_consensus.cc:1261] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Refusing update from remote peer 769982e92f784b7cbcf0f23c4cc7b5ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.498668 9310 consensus_queue.cc:1035] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.498817 9310 consensus_queue.cc:1035] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.499143 9312 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: TxnStatusTablet state changed. Reason: New leader 769982e92f784b7cbcf0f23c4cc7b5ee. Latest consensus state: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.499220 9312 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:04:23.499351 9324 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: TxnStatusTablet state changed. Reason: New leader 769982e92f784b7cbcf0f23c4cc7b5ee. Latest consensus state: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.499423 9324 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:04:23.500348 9310 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.500416 9310 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:04:23.500561 9310 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.500620 9310 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 769982e92f784b7cbcf0f23c4cc7b5ee: This TxnStatusTablet replica's current role is: LEADER
I20260620 22:04:23.500837 9324 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.500905 9324 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P 0d61d4839879439193e12d714d9b0c07: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:04:23.501833 9312 tablet_replica.cc:439] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } } }
I20260620 22:04:23.501914 9312 tablet_replica.cc:442] T 70e2e35aa8a34c5bb0c9a000cb854e38 P abd61dd786d84685b9ed6e5850abd07a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260620 22:04:23.505829 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.503291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:57229 (local address 127.1.55.195:46639)
0620 22:04:23.503318 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.503319 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.503447 (+ 128us) server_negotiation.cc:407] Connection header received
0620 22:04:23.503525 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.503526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.503534 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.503565 (+ 31us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:04:23.503711 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.504109 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.505199 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.505375 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.505446 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.505627 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.505653 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.505696 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.505766 (+ 70us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.505779 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260620 22:04:23.506002 9356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.503253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:46639 (local address 127.1.55.194:57229)
0620 22:04:23.503376 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.503384 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.503460 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.503612 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.503612 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.503614 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:04:23.503652 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.503653 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.504191 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.504192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.505108 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.505110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.505449 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.505450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.505522 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.505535 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.505712 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.505713 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.505760 (+ 47us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.505803 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":69,"threads_started":1}
I20260620 22:04:23.507936 9232 raft_consensus.cc:1261] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Refusing update from remote peer 0d61d4839879439193e12d714d9b0c07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.507959 8955 raft_consensus.cc:1261] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Refusing update from remote peer 0d61d4839879439193e12d714d9b0c07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.508140 9314 consensus_queue.cc:1035] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.508262 9314 consensus_queue.cc:1035] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.516252 9287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.512929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41425 (local address 127.1.55.195:38799)
0620 22:04:23.512989 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.512999 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.513056 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.514042 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.514043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.514044 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:04:23.514093 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.514094 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.514723 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.514724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.515564 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.515567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.515887 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.515887 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.515944 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.515955 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.516113 (+ 158us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.516115 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.516154 (+ 39us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.516190 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260620 22:04:23.516578 9304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.512962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:38799 (local address 127.1.55.194:41425)
0620 22:04:23.512996 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.512998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.513948 (+ 950us) server_negotiation.cc:407] Connection header received
0620 22:04:23.513966 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.513967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.513976 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.514041 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:04:23.514146 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.514635 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.515628 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.515810 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.515885 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.516039 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.516073 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.516114 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.516482 (+ 368us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.516497 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:04:23.528095 8798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:23.528177 8798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52784:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:23.528716 8798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: Sending DeleteTablet for 3 replicas of tablet 5928823e0ae94ffa92a588ed83ab9bf7
I20260620 22:04:23.528944 9075 tablet_service.cc:1514] Processing DeleteTablet for tablet 5928823e0ae94ffa92a588ed83ab9bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:53704
I20260620 22:04:23.528957 9215 tablet_service.cc:1514] Processing DeleteTablet for tablet 5928823e0ae94ffa92a588ed83ab9bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36862
I20260620 22:04:23.529057 9330 tablet_replica.cc:330] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: stopping tablet replica
I20260620 22:04:23.529062 8935 tablet_service.cc:1514] Processing DeleteTablet for tablet 5928823e0ae94ffa92a588ed83ab9bf7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:56286
I20260620 22:04:23.529124 9330 raft_consensus.cc:2229] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:04:23.529172 9330 raft_consensus.cc:2258] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.529165 9329 tablet_replica.cc:330] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: stopping tablet replica
I20260620 22:04:23.529222 9329 raft_consensus.cc:2229] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:23.529241 9331 tablet_replica.cc:330] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: stopping tablet replica
I20260620 22:04:23.529256 9329 raft_consensus.cc:2258] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.529294 9331 raft_consensus.cc:2229] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:23.529335 9331 raft_consensus.cc:2258] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.529474 9330 ts_tablet_manager.cc:1905] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.529587 9329 ts_tablet_manager.cc:1905] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.529642 9331 ts_tablet_manager.cc:1905] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.531175 9330 ts_tablet_manager.cc:1918] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:04:23.531230 9330 log.cc:1196] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/5928823e0ae94ffa92a588ed83ab9bf7
I20260620 22:04:23.531368 9329 ts_tablet_manager.cc:1918] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:04:23.531420 9329 log.cc:1196] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/5928823e0ae94ffa92a588ed83ab9bf7
I20260620 22:04:23.531437 9330 ts_tablet_manager.cc:1939] T 5928823e0ae94ffa92a588ed83ab9bf7 P 0d61d4839879439193e12d714d9b0c07: Deleting consensus metadata
I20260620 22:04:23.531632 9329 ts_tablet_manager.cc:1939] T 5928823e0ae94ffa92a588ed83ab9bf7 P abd61dd786d84685b9ed6e5850abd07a: Deleting consensus metadata
I20260620 22:04:23.531704 8783 catalog_manager.cc:4841] TS 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425): tablet 5928823e0ae94ffa92a588ed83ab9bf7 (table test-table [id=1e502d0df650444ab6d3a7c8ba7c8333]) successfully deleted
I20260620 22:04:23.531932 8784 catalog_manager.cc:4841] TS abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453): tablet 5928823e0ae94ffa92a588ed83ab9bf7 (table test-table [id=1e502d0df650444ab6d3a7c8ba7c8333]) successfully deleted
I20260620 22:04:23.532682 9331 ts_tablet_manager.cc:1918] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:04:23.532743 9331 log.cc:1196] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/5928823e0ae94ffa92a588ed83ab9bf7
I20260620 22:04:23.532982 9331 ts_tablet_manager.cc:1939] T 5928823e0ae94ffa92a588ed83ab9bf7 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting consensus metadata
I20260620 22:04:23.533267 8785 catalog_manager.cc:4841] TS 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639): tablet 5928823e0ae94ffa92a588ed83ab9bf7 (table test-table [id=1e502d0df650444ab6d3a7c8ba7c8333]) successfully deleted
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
W20260620 22:04:23.552258 8848 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:23.546888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52794 (local address 127.1.55.254:33309)
0620 22:04:23.546952 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.546954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.547075 (+ 121us) server_negotiation.cc:407] Connection header received
0620 22:04:23.547102 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.547103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.547114 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.547180 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:23.547702 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.548493 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.549206 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.549533 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.549605 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.552203 (+ 2598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52794: BlockingRecv error: recv got EOF from 127.0.0.1:52794 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Jun 20 22:04:23 dist-test-slave-xw35 krb5kdc[8753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993063, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM
I20260620 22:04:23.559629 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.552895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52802 (local address 127.1.55.254:33309)
0620 22:04:23.552925 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.552926 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.553203 (+ 277us) server_negotiation.cc:407] Connection header received
0620 22:04:23.553223 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.553223 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.553232 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.553280 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:23.553780 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.554440 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.555080 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.555337 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.555397 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.557275 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:23.557277 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:23.557277 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:23.557283 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:23.558606 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.558930 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.558931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.558931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.558992 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:23.559174 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:23.559175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:23.559175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:23.559298 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:23.559394 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.559461 (+ 67us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.559537 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:04:23.561008 8798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:04:23.561177 8798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:04:23.562431 8935 tablet_service.cc:1467] Processing CreateTablet for tablet 5a48d45d845e4831a7ada9639977e8fe (DEFAULT_TABLE table=test-table [id=d0937c4047c54255bc11e767f61232d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.562479 9215 tablet_service.cc:1467] Processing CreateTablet for tablet 5a48d45d845e4831a7ada9639977e8fe (DEFAULT_TABLE table=test-table [id=d0937c4047c54255bc11e767f61232d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.562474 9075 tablet_service.cc:1467] Processing CreateTablet for tablet 5a48d45d845e4831a7ada9639977e8fe (DEFAULT_TABLE table=test-table [id=d0937c4047c54255bc11e767f61232d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.562584 9215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a48d45d845e4831a7ada9639977e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.562590 8935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a48d45d845e4831a7ada9639977e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.562623 9075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a48d45d845e4831a7ada9639977e8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.563731 9306 tablet_bootstrap.cc:492] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: Bootstrap starting.
I20260620 22:04:23.563764 9307 tablet_bootstrap.cc:492] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: Bootstrap starting.
I20260620 22:04:23.564116 9306 tablet_bootstrap.cc:654] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.564133 9307 tablet_bootstrap.cc:654] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.564415 9311 tablet_bootstrap.cc:492] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: Bootstrap starting.
I20260620 22:04:23.564703 9311 tablet_bootstrap.cc:654] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.565205 9311 tablet_bootstrap.cc:492] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: No bootstrap required, opened a new log
I20260620 22:04:23.565253 9306 tablet_bootstrap.cc:492] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: No bootstrap required, opened a new log
I20260620 22:04:23.565249 9311 ts_tablet_manager.cc:1397] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:04:23.565285 9306 ts_tablet_manager.cc:1397] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:04:23.565347 9311 raft_consensus.cc:348] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.565361 9306 raft_consensus.cc:348] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.565405 9311 raft_consensus.cc:374] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.565410 9306 raft_consensus.cc:374] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.565429 9311 raft_consensus.cc:729] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d61d4839879439193e12d714d9b0c07, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.565431 9306 raft_consensus.cc:729] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769982e92f784b7cbcf0f23c4cc7b5ee, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.565469 9306 consensus_queue.cc:260] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.565491 9311 consensus_queue.cc:260] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.565569 9306 ts_tablet_manager.cc:1428] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.565582 9311 ts_tablet_manager.cc:1428] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.566227 9307 tablet_bootstrap.cc:492] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: No bootstrap required, opened a new log
I20260620 22:04:23.566286 9307 ts_tablet_manager.cc:1397] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260620 22:04:23.566416 9307 raft_consensus.cc:348] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.566483 9307 raft_consensus.cc:374] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.566504 9307 raft_consensus.cc:729] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd61dd786d84685b9ed6e5850abd07a, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.566545 9307 consensus_queue.cc:260] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.566633 9307 ts_tablet_manager.cc:1428] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.621336 9324 raft_consensus.cc:482] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:04:23.621428 9324 raft_consensus.cc:504] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.621584 9324 leader_election.cc:288] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453), 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639)
I20260620 22:04:23.621730 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a48d45d845e4831a7ada9639977e8fe" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a" is_pre_election: true
I20260620 22:04:23.621730 9232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a48d45d845e4831a7ada9639977e8fe" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" is_pre_election: true
I20260620 22:04:23.621838 9232 raft_consensus.cc:2454] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 0.
I20260620 22:04:23.621838 8955 raft_consensus.cc:2454] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 0.
I20260620 22:04:23.621974 9028 leader_election.cc:302] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, abd61dd786d84685b9ed6e5850abd07a; no voters:
I20260620 22:04:23.622071 9324 raft_consensus.cc:2781] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:04:23.622107 9324 raft_consensus.cc:482] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:04:23.622161 9324 raft_consensus.cc:3037] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.622746 9324 raft_consensus.cc:504] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.622869 9324 leader_election.cc:288] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 election: Requested vote from peers abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453), 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639)
I20260620 22:04:23.622982 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a48d45d845e4831a7ada9639977e8fe" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a"
I20260620 22:04:23.623052 8955 raft_consensus.cc:3037] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.623104 9232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a48d45d845e4831a7ada9639977e8fe" candidate_uuid: "0d61d4839879439193e12d714d9b0c07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee"
I20260620 22:04:23.623172 9232 raft_consensus.cc:3037] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.623770 8955 raft_consensus.cc:2454] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 1.
I20260620 22:04:23.623770 9232 raft_consensus.cc:2454] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d61d4839879439193e12d714d9b0c07 in term 1.
I20260620 22:04:23.623914 9029 leader_election.cc:302] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, 769982e92f784b7cbcf0f23c4cc7b5ee; no voters:
I20260620 22:04:23.624001 9324 raft_consensus.cc:2781] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:23.624068 9324 raft_consensus.cc:686] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 1 LEADER]: Becoming Leader. State: Replica: 0d61d4839879439193e12d714d9b0c07, State: Running, Role: LEADER
I20260620 22:04:23.624107 9324 consensus_queue.cc:237] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.624644 8797 catalog_manager.cc:5495] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d61d4839879439193e12d714d9b0c07 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "0d61d4839879439193e12d714d9b0c07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } health_report { overall_health: UNKNOWN } } }
I20260620 22:04:23.638995 9304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.636978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53718 (local address 127.1.55.194:41425)
0620 22:04:23.637021 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.637023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.637030 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:23.637080 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.637080 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.637090 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.637133 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:04:23.637248 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.637724 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.638411 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.638619 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.638665 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.638784 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.638823 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.638856 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.638905 (+ 49us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.638917 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 22:04:23.639616 9232 raft_consensus.cc:1261] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Refusing update from remote peer 0d61d4839879439193e12d714d9b0c07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.639639 8955 raft_consensus.cc:1261] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Refusing update from remote peer 0d61d4839879439193e12d714d9b0c07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.639819 9316 consensus_queue.cc:1035] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.639900 9324 consensus_queue.cc:1035] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.641878 8798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:23.641978 8798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:23.642524 8798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: Sending DeleteTablet for 3 replicas of tablet 5a48d45d845e4831a7ada9639977e8fe
I20260620 22:04:23.642742 9215 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a48d45d845e4831a7ada9639977e8fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36862
I20260620 22:04:23.642741 8935 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a48d45d845e4831a7ada9639977e8fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:56286
I20260620 22:04:23.642817 9075 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a48d45d845e4831a7ada9639977e8fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:53704
I20260620 22:04:23.642834 9329 tablet_replica.cc:330] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: stopping tablet replica
I20260620 22:04:23.642882 9329 raft_consensus.cc:2229] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:23.642915 9330 tablet_replica.cc:330] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: stopping tablet replica
I20260620 22:04:23.642931 9329 raft_consensus.cc:2258] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.642968 9330 raft_consensus.cc:2229] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:04:23.642995 9331 tablet_replica.cc:330] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: stopping tablet replica
I20260620 22:04:23.643015 9330 raft_consensus.cc:2258] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.643060 9331 raft_consensus.cc:2229] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:23.643003 8798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 22:04:23.643105 9331 raft_consensus.cc:2258] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 22:04:23.643121 8798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:04:23.643394 9329 ts_tablet_manager.cc:1905] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.644520 9330 ts_tablet_manager.cc:1905] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.644556 9331 ts_tablet_manager.cc:1905] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.645143 8935 tablet_service.cc:1467] Processing CreateTablet for tablet ace7fa9cf0364b5ca64a0bd123e43a80 (DEFAULT_TABLE table=test-table [id=36350ac588f247d49f19aca2dd243fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.645169 9215 tablet_service.cc:1467] Processing CreateTablet for tablet ace7fa9cf0364b5ca64a0bd123e43a80 (DEFAULT_TABLE table=test-table [id=36350ac588f247d49f19aca2dd243fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.645314 9215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ace7fa9cf0364b5ca64a0bd123e43a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.645589 9329 ts_tablet_manager.cc:1918] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:04:23.645633 9329 log.cc:1196] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/5a48d45d845e4831a7ada9639977e8fe
I20260620 22:04:23.645840 9329 ts_tablet_manager.cc:1939] T 5a48d45d845e4831a7ada9639977e8fe P abd61dd786d84685b9ed6e5850abd07a: Deleting consensus metadata
I20260620 22:04:23.645965 8935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ace7fa9cf0364b5ca64a0bd123e43a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.645964 9331 ts_tablet_manager.cc:1918] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:04:23.646011 9331 log.cc:1196] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/5a48d45d845e4831a7ada9639977e8fe
I20260620 22:04:23.646004 9330 ts_tablet_manager.cc:1918] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:04:23.646050 9330 log.cc:1196] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/5a48d45d845e4831a7ada9639977e8fe
I20260620 22:04:23.646219 9331 ts_tablet_manager.cc:1939] T 5a48d45d845e4831a7ada9639977e8fe P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting consensus metadata
I20260620 22:04:23.646250 9330 ts_tablet_manager.cc:1939] T 5a48d45d845e4831a7ada9639977e8fe P 0d61d4839879439193e12d714d9b0c07: Deleting consensus metadata
I20260620 22:04:23.646579 9306 tablet_bootstrap.cc:492] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: Bootstrap starting.
I20260620 22:04:23.646638 8785 catalog_manager.cc:4841] TS 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639): tablet 5a48d45d845e4831a7ada9639977e8fe (table test-table [id=d0937c4047c54255bc11e767f61232d5]) successfully deleted
I20260620 22:04:23.646755 8783 catalog_manager.cc:4841] TS 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425): tablet 5a48d45d845e4831a7ada9639977e8fe (table test-table [id=d0937c4047c54255bc11e767f61232d5]) successfully deleted
I20260620 22:04:23.646871 9306 tablet_bootstrap.cc:654] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.647222 9307 tablet_bootstrap.cc:492] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a: Bootstrap starting.
I20260620 22:04:23.647265 9075 tablet_service.cc:1467] Processing CreateTablet for tablet ace7fa9cf0364b5ca64a0bd123e43a80 (DEFAULT_TABLE table=test-table [id=36350ac588f247d49f19aca2dd243fea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:23.647358 9075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ace7fa9cf0364b5ca64a0bd123e43a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:23.647501 9306 tablet_bootstrap.cc:492] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: No bootstrap required, opened a new log
I20260620 22:04:23.647578 9306 ts_tablet_manager.cc:1397] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:23.647652 9307 tablet_bootstrap.cc:654] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.647672 9306 raft_consensus.cc:348] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.647739 9306 raft_consensus.cc:374] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.647766 9306 raft_consensus.cc:729] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 769982e92f784b7cbcf0f23c4cc7b5ee, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.647814 9306 consensus_queue.cc:260] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.647895 9306 ts_tablet_manager.cc:1428] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.648591 9311 tablet_bootstrap.cc:492] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: Bootstrap starting.
I20260620 22:04:23.648604 9307 tablet_bootstrap.cc:492] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a: No bootstrap required, opened a new log
I20260620 22:04:23.648648 9307 ts_tablet_manager.cc:1397] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:04:23.648795 9307 raft_consensus.cc:348] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.648865 9307 raft_consensus.cc:374] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.648867 9311 tablet_bootstrap.cc:654] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:23.648891 9307 raft_consensus.cc:729] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abd61dd786d84685b9ed6e5850abd07a, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.648933 9307 consensus_queue.cc:260] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.649025 9307 ts_tablet_manager.cc:1428] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.649144 8784 catalog_manager.cc:4841] TS abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453): tablet 5a48d45d845e4831a7ada9639977e8fe (table test-table [id=d0937c4047c54255bc11e767f61232d5]) successfully deleted
I20260620 22:04:23.649540 9311 tablet_bootstrap.cc:492] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: No bootstrap required, opened a new log
I20260620 22:04:23.649609 9311 ts_tablet_manager.cc:1397] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:04:23.649724 9311 raft_consensus.cc:348] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.649796 9311 raft_consensus.cc:374] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:23.649827 9311 raft_consensus.cc:729] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d61d4839879439193e12d714d9b0c07, State: Initialized, Role: FOLLOWER
I20260620 22:04:23.649878 9311 consensus_queue.cc:260] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.649976 9311 ts_tablet_manager.cc:1428] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:23.869567 9353 raft_consensus.cc:482] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:04:23.869648 9353 raft_consensus.cc:504] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.869796 9353 leader_election.cc:288] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453), 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425)
I20260620 22:04:23.870003 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ace7fa9cf0364b5ca64a0bd123e43a80" candidate_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a" is_pre_election: true
I20260620 22:04:23.870003 9095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ace7fa9cf0364b5ca64a0bd123e43a80" candidate_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d61d4839879439193e12d714d9b0c07" is_pre_election: true
I20260620 22:04:23.870096 8955 raft_consensus.cc:2454] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769982e92f784b7cbcf0f23c4cc7b5ee in term 0.
I20260620 22:04:23.870105 9095 raft_consensus.cc:2454] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 769982e92f784b7cbcf0f23c4cc7b5ee in term 0.
I20260620 22:04:23.870244 9168 leader_election.cc:302] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 769982e92f784b7cbcf0f23c4cc7b5ee, abd61dd786d84685b9ed6e5850abd07a; no voters:
I20260620 22:04:23.870334 9353 raft_consensus.cc:2781] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:04:23.870365 9353 raft_consensus.cc:482] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:04:23.870393 9353 raft_consensus.cc:3037] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.871025 9353 raft_consensus.cc:504] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.871174 9353 leader_election.cc:288] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [CANDIDATE]: Term 1 election: Requested vote from peers abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453), 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425)
I20260620 22:04:23.871327 9095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ace7fa9cf0364b5ca64a0bd123e43a80" candidate_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d61d4839879439193e12d714d9b0c07"
I20260620 22:04:23.871333 8955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ace7fa9cf0364b5ca64a0bd123e43a80" candidate_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abd61dd786d84685b9ed6e5850abd07a"
I20260620 22:04:23.871395 9095 raft_consensus.cc:3037] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.871397 8955 raft_consensus.cc:3037] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:23.872020 9095 raft_consensus.cc:2454] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 769982e92f784b7cbcf0f23c4cc7b5ee in term 1.
I20260620 22:04:23.872153 8955 raft_consensus.cc:2454] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 769982e92f784b7cbcf0f23c4cc7b5ee in term 1.
I20260620 22:04:23.872154 9167 leader_election.cc:302] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d61d4839879439193e12d714d9b0c07, 769982e92f784b7cbcf0f23c4cc7b5ee; no voters:
I20260620 22:04:23.872308 9353 raft_consensus.cc:2781] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:23.872363 9353 raft_consensus.cc:686] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 LEADER]: Becoming Leader. State: Replica: 769982e92f784b7cbcf0f23c4cc7b5ee, State: Running, Role: LEADER
I20260620 22:04:23.872453 9353 consensus_queue.cc:237] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } }
I20260620 22:04:23.872982 8798 catalog_manager.cc:5495] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195). New cstate: current_term: 1 leader_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "769982e92f784b7cbcf0f23c4cc7b5ee" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46639 } health_report { overall_health: HEALTHY } } }
I20260620 22:04:23.933117 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.930986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36884 (local address 127.1.55.195:46639)
0620 22:04:23.931118 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.931119 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.931124 (+ 5us) server_negotiation.cc:407] Connection header received
0620 22:04:23.931139 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.931140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.931147 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.931183 (+ 36us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:04:23.931291 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.931698 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.932404 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.932612 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.932674 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.932828 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.932861 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.932946 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.933017 (+ 71us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.933034 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260620 22:04:23.936648 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.935107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:36283 (local address 127.1.55.195:46639)
0620 22:04:23.935146 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:23.935148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:23.935153 (+ 5us) server_negotiation.cc:407] Connection header received
0620 22:04:23.935166 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:23.935167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:23.935172 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:23.935209 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:04:23.935285 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.935627 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.936198 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.936341 (+ 143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.936381 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.936478 (+ 97us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.936495 (+ 17us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.936536 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:23.936578 (+ 42us) server_negotiation.cc:299] Negotiation successful
0620 22:04:23.936592 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":26}
I20260620 22:04:23.936659 9287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.934973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:46639 (local address 127.1.55.195:36283)
0620 22:04:23.935021 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.935030 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:23.935063 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:23.935224 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:23.935224 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:23.935225 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0620 22:04:23.935251 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.935252 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.935677 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.935677 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.936138 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:23.936139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:23.936401 (+ 262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:23.936402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:23.936433 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:23.936436 (+ 3us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0620 22:04:23.936550 (+ 114us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0620 22:04:23.936551 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:04:23.936578 (+ 27us) client_negotiation.cc:240] Negotiation successful
0620 22:04:23.936607 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":1}
I20260620 22:04:23.938113 8955 raft_consensus.cc:1261] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Refusing update from remote peer 769982e92f784b7cbcf0f23c4cc7b5ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.938146 9095 raft_consensus.cc:1261] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Refusing update from remote peer 769982e92f784b7cbcf0f23c4cc7b5ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:23.938345 9353 consensus_queue.cc:1035] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d61d4839879439193e12d714d9b0c07" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.938449 9346 consensus_queue.cc:1035] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "abd61dd786d84685b9ed6e5850abd07a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:23.948045 8798 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:23.948132 8798 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:23.948711 8798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73718cd468c64708bf16901551a19a4b: Sending DeleteTablet for 3 replicas of tablet ace7fa9cf0364b5ca64a0bd123e43a80
I20260620 22:04:23.948945 9215 tablet_service.cc:1514] Processing DeleteTablet for tablet ace7fa9cf0364b5ca64a0bd123e43a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36862
I20260620 22:04:23.949036 9331 tablet_replica.cc:330] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: stopping tablet replica
I20260620 22:04:23.949040 9075 tablet_service.cc:1514] Processing DeleteTablet for tablet ace7fa9cf0364b5ca64a0bd123e43a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:53704
I20260620 22:04:23.949090 9331 raft_consensus.cc:2229] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:04:23.949126 8935 tablet_service.cc:1514] Processing DeleteTablet for tablet ace7fa9cf0364b5ca64a0bd123e43a80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:23 UTC) from {username='oryx', principal='oryx/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:56286
I20260620 22:04:23.949167 9331 raft_consensus.cc:2258] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.949205 9330 tablet_replica.cc:330] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: stopping tablet replica
I20260620 22:04:23.949259 9330 raft_consensus.cc:2229] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:23.949301 9330 raft_consensus.cc:2258] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.949370 9329 tablet_replica.cc:330] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a: stopping tablet replica
I20260620 22:04:23.949422 9329 raft_consensus.cc:2229] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:23.949465 9329 raft_consensus.cc:2258] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:23.949540 9331 ts_tablet_manager.cc:1905] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.949865 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 8870
I20260620 22:04:23.949892 9330 ts_tablet_manager.cc:1905] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.949928 9329 ts_tablet_manager.cc:1905] T ace7fa9cf0364b5ca64a0bd123e43a80 P abd61dd786d84685b9ed6e5850abd07a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:23.951200 9330 ts_tablet_manager.cc:1918] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:04:23.951234 9330 log.cc:1196] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/ace7fa9cf0364b5ca64a0bd123e43a80
I20260620 22:04:23.951370 9330 ts_tablet_manager.cc:1939] T ace7fa9cf0364b5ca64a0bd123e43a80 P 0d61d4839879439193e12d714d9b0c07: Deleting consensus metadata
I20260620 22:04:23.951990 8783 catalog_manager.cc:4841] TS 0d61d4839879439193e12d714d9b0c07 (127.1.55.194:41425): tablet ace7fa9cf0364b5ca64a0bd123e43a80 (table test-table [id=36350ac588f247d49f19aca2dd243fea]) successfully deleted
I20260620 22:04:23.953775 9331 ts_tablet_manager.cc:1918] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260620 22:04:23.953838 9331 log.cc:1196] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/ace7fa9cf0364b5ca64a0bd123e43a80
I20260620 22:04:23.954017 9331 ts_tablet_manager.cc:1939] T ace7fa9cf0364b5ca64a0bd123e43a80 P 769982e92f784b7cbcf0f23c4cc7b5ee: Deleting consensus metadata
I20260620 22:04:23.954300 8785 catalog_manager.cc:4841] TS 769982e92f784b7cbcf0f23c4cc7b5ee (127.1.55.195:46639): tablet ace7fa9cf0364b5ca64a0bd123e43a80 (table test-table [id=36350ac588f247d49f19aca2dd243fea]) successfully deleted
W20260620 22:04:23.957413 8784 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:34453 (error 108)
I20260620 22:04:23.957650 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 9010
I20260620 22:04:23.961622 9389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:23.957792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:34453 (local address 127.0.0.1:56300)
0620 22:04:23.961545 (+ 3753us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:23.961593 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:34453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3738,"thread_start_us":32,"threads_started":1}
W20260620 22:04:23.961839 8784 catalog_manager.cc:4584] TS abd61dd786d84685b9ed6e5850abd07a (127.1.55.193:34453): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ace7fa9cf0364b5ca64a0bd123e43a80: Network error: Client connection negotiation failed: client connection to 127.1.55.193:34453: connect: Connection refused (error 111)
I20260620 22:04:23.964896 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 9150
I20260620 22:04:23.970118 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 8766
2026-06-20T22:04:23Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2620 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:04:24 dist-test-slave-xw35 krb5kdc[9392](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:04:24 dist-test-slave-xw35 krb5kdc[9392](info): set up 2 sockets
Jun 20 22:04:24 dist-test-slave-xw35 krb5kdc[9392](info): commencing operation
krb5kdc: starting...
W20260620 22:04:24.961755 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.971s user 0.000s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:04:25 dist-test-slave-xw35 krb5kdc[9392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993065, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:04:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:04:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:04:25.064195 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:36543
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:36543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:25.137881 9405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:25.138046 9405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:25.138065 9405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:25.139114 9405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:04:25.139147 9405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:25.139161 9405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:25.139174 9405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:04:25.139185 9405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:04:25.140532 9405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:36543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:36543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:25.140697 9405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:25.140834 9405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:25.145074 9411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:25.145067 9413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:25.145067 9410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:25.145108 9405 server_base.cc:1034] running on GCE node
I20260620 22:04:25.145452 9405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:25.145769 9405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:25.146919 9405 hybrid_clock.cc:648] HybridClock initialized: now 1781993065146907 us; error 26 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-06-20T22:04:25Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1180 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:04:25 dist-test-slave-xw35 krb5kdc[9418](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:04:25 dist-test-slave-xw35 krb5kdc[9418](info): set up 2 sockets
Jun 20 22:04:25 dist-test-slave-xw35 krb5kdc[9418](info): commencing operation
krb5kdc: starting...
W20260620 22:04:26.133700 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.963s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:04:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:04:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:04:26.238415 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42625
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:42625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:26.311010 9431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:26.311201 9431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:26.311235 9431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:26.312320 9431 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:04:26.312377 9431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:26.312402 9431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:26.312430 9431 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:04:26.312450 9431 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:04:26.313870 9431 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:42625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:26.314109 9431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:26.314343 9431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:26.318729 9439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.318744 9437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.318737 9436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:26.318789 9431 server_base.cc:1034] running on GCE node
I20260620 22:04:26.319101 9431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:26.319314 9431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:26.320446 9431 hybrid_clock.cc:648] HybridClock initialized: now 1781993066320433 us; error 27 us; skew 500 ppm
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:26.322777 9431 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:04:26.323184 9431 webserver.cc:460] Webserver started at http://127.1.55.254:44569/ using document root <none> and password file <none>
I20260620 22:04:26.323422 9431 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:26.323480 9431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:26.323627 9431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:26.324509 9431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "3ecaa5b2da5843a1bf28d936069f9e9d"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "e1d6b5485611af4f20e0925c591b413d"
server_key_iv: "adda41f17c0087d2217266601e99fc0c"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.324833 9431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "3ecaa5b2da5843a1bf28d936069f9e9d"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "e1d6b5485611af4f20e0925c591b413d"
server_key_iv: "adda41f17c0087d2217266601e99fc0c"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.326089 9431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260620 22:04:26.326754 9446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.326918 9431 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:26.327008 9431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "3ecaa5b2da5843a1bf28d936069f9e9d"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "e1d6b5485611af4f20e0925c591b413d"
server_key_iv: "adda41f17c0087d2217266601e99fc0c"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.327078 9431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:26.334913 9431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:26.336553 9431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:26.336694 9431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:26.340539 9431 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:42625
I20260620 22:04:26.340560 9498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:42625 every 8 connection(s)
I20260620 22:04:26.340895 9431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:04:26.341645 9499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:26.342044 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 9431
I20260620 22:04:26.342157 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:04:26.342334 1247 external_mini_cluster.cc:1428] Setting key cbfc9f627c3b85650acab87673316b17
I20260620 22:04:26.344203 9499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Bootstrap starting.
I20260620 22:04:26.344693 9499 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:26.344942 9499 log.cc:824] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:26.345572 9499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: No bootstrap required, opened a new log
I20260620 22:04:26.347306 9499 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } }
I20260620 22:04:26.347450 9499 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:26.347491 9499 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ecaa5b2da5843a1bf28d936069f9e9d, State: Initialized, Role: FOLLOWER
I20260620 22:04:26.347651 9499 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } }
I20260620 22:04:26.347743 9499 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:04:26.347787 9499 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:04:26.347833 9499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 0 FOLLOWER]: Advancing to term 1
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:04:26.348454 9499 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } }
I20260620 22:04:26.348546 9499 leader_election.cc:302] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ecaa5b2da5843a1bf28d936069f9e9d; no voters:
I20260620 22:04:26.348704 9499 leader_election.cc:288] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:04:26.348770 9504 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:26.348901 9504 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 1 LEADER]: Becoming Leader. State: Replica: 3ecaa5b2da5843a1bf28d936069f9e9d, State: Running, Role: LEADER
I20260620 22:04:26.348948 9499 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:04:26.348989 9504 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } }
I20260620 22:04:26.349293 9505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } } }
I20260620 22:04:26.349385 9505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:26.349603 9506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ecaa5b2da5843a1bf28d936069f9e9d. Latest consensus state: current_term: 1 leader_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } } }
I20260620 22:04:26.349673 9506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:26.349784 9510 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:04:26.350256 9510 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:04:26.352011 9510 catalog_manager.cc:1347] Generated new cluster ID: 0c37e17b5f70414d99f681df1afd93b7
I20260620 22:04:26.352057 9510 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:04:26.352495 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:26.342793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60064 (local address 127.1.55.254:42625)
0620 22:04:26.342955 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:26.342963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:26.342994 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:04:26.343335 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:26.343341 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:26.343380 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:26.343480 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:26.344233 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.345126 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.345945 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.346343 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.346455 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:26.349021 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:26.349024 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:26.349025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:26.349052 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:26.351075 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:26.351413 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:26.351416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:26.351416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:26.351501 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:26.351671 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:26.351672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:26.351672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:26.351937 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:26.352064 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:26.352196 (+ 132us) server_negotiation.cc:299] Negotiation successful
0620 22:04:26.352322 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260620 22:04:26.380416 9510 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:04:26.381003 9510 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:04:26.386574 9510 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Generated new TSK 0
I20260620 22:04:26.386718 9510 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:04:26.408409 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42625
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:26.482662 9525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:26.482821 9525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:26.482841 9525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:26.483848 9525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:26.483883 9525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:26.483907 9525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:04:26.485153 9525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:26.485321 9525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:26.485558 9525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:26.490025 9533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.490017 9531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.490016 9530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:26.490206 9525 server_base.cc:1034] running on GCE node
I20260620 22:04:26.490391 9525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:26.490617 9525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:26.491765 9525 hybrid_clock.cc:648] HybridClock initialized: now 1781993066491748 us; error 35 us; skew 500 ppm
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:26.498208 9525 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:04:26.498618 9525 webserver.cc:460] Webserver started at http://127.1.55.193:45585/ using document root <none> and password file <none>
I20260620 22:04:26.498813 9525 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:26.498870 9525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:26.498998 9525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:26.499925 9525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "9c3bea804412428e996ba11dec864627"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "ccae7f21485c86eb1feceb657d4ef1bf"
server_key_iv: "acb8cd078c311b7181b1c86970c39f3f"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.500279 9525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "9c3bea804412428e996ba11dec864627"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "ccae7f21485c86eb1feceb657d4ef1bf"
server_key_iv: "acb8cd078c311b7181b1c86970c39f3f"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.501443 9525 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:04:26.502161 9540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.502351 9525 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:26.502444 9525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "9c3bea804412428e996ba11dec864627"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "ccae7f21485c86eb1feceb657d4ef1bf"
server_key_iv: "acb8cd078c311b7181b1c86970c39f3f"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.502516 9525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:26.512120 9525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:26.514068 9525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:26.514204 9525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:26.514389 9525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:26.514634 9525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:26.514681 9525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.514711 9525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:26.514735 9525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.520027 9525 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:42235
I20260620 22:04:26.520081 9653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:42235 every 8 connection(s)
I20260620 22:04:26.520349 9525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:04:26.522305 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 9525
I20260620 22:04:26.522435 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:04:26.522643 1247 external_mini_cluster.cc:1428] Setting key e684550b6276acc135c6c14f5764db95
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:04:26.529150 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:26.520906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:48737 (local address 127.1.55.254:42625)
0620 22:04:26.520956 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:26.520957 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:26.521136 (+ 179us) server_negotiation.cc:407] Connection header received
0620 22:04:26.521528 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:26.521529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:26.521538 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:26.521598 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:26.522386 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.523110 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.524137 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.524329 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.524400 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:26.526208 (+ 1808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:26.526209 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:26.526210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:26.526217 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:26.527794 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:26.528175 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:26.528177 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:26.528177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:26.528253 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:26.528500 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:26.528501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:26.528501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:26.528643 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:26.528715 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:26.528939 (+ 224us) server_negotiation.cc:299] Negotiation successful
0620 22:04:26.529022 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:04:26.529253 9656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:26.520861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:48737)
0620 22:04:26.521021 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:26.521054 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:26.521421 (+ 367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:26.521644 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:26.521647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:26.522135 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:26.522294 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:26.522297 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.523224 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.523225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:26.524034 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:26.524036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.524404 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.524405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:26.524515 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:26.524924 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:26.524931 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:26.526123 (+ 1192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:26.527886 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:26.527891 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:26.527893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:26.528105 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:26.528322 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:26.528322 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:26.528322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:26.528426 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:26.528708 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:26.528712 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:26.528818 (+ 106us) client_negotiation.cc:769] Sending connection context
0620 22:04:26.528893 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 22:04:26.529074 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":89,"threads_started":1}
I20260620 22:04:26.529686 9654 heartbeater.cc:347] Connected to a master server at 127.1.55.254:42625
I20260620 22:04:26.529769 9654 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:26.529930 9654 heartbeater.cc:511] Master 127.1.55.254:42625 requested a full tablet report, sending...
I20260620 22:04:26.530437 9463 ts_manager.cc:194] Registered new tserver with Master: 9c3bea804412428e996ba11dec864627 (127.1.55.193:42235)
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
I20260620 22:04:26.531036 9463 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:48737
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:04:26.545734 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42625
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:26.617390 9659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:26.617592 9659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:26.617643 9659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:26.618732 9659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:26.618804 9659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:26.618844 9659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:04:26.620196 9659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:26.620440 9659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:26.620627 9659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:26.624878 9664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.624884 9665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:26.625025 9659 server_base.cc:1034] running on GCE node
W20260620 22:04:26.625140 9667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:26.625312 9659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:26.625540 9659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:26.626708 9659 hybrid_clock.cc:648] HybridClock initialized: now 1781993066626698 us; error 24 us; skew 500 ppm
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:26.628844 9659 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:04:26.629278 9659 webserver.cc:460] Webserver started at http://127.1.55.194:33717/ using document root <none> and password file <none>
I20260620 22:04:26.629549 9659 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:26.629621 9659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:26.629750 9659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:26.630666 9659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "871a5a6661e44a309e5a2a39bc761faf"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "7ceb755418402e3adb96170bd64b0692"
server_key_iv: "3b95c33fb9be2d3f60854987e5c2c358"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.630972 9659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "871a5a6661e44a309e5a2a39bc761faf"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "7ceb755418402e3adb96170bd64b0692"
server_key_iv: "3b95c33fb9be2d3f60854987e5c2c358"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.632094 9659 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:04:26.632794 9674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.632943 9659 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:04:26.633024 9659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "871a5a6661e44a309e5a2a39bc761faf"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "7ceb755418402e3adb96170bd64b0692"
server_key_iv: "3b95c33fb9be2d3f60854987e5c2c358"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.633098 9659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:26.644626 9659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:26.646363 9659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:26.646522 9659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:26.646725 9659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:26.646978 9659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:26.647028 9659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.647063 9659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:26.647089 9659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.652817 9659 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:41055
I20260620 22:04:26.652859 9787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:41055 every 8 connection(s)
I20260620 22:04:26.653090 9659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:04:26.659257 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 9659
I20260620 22:04:26.659384 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:04:26.659572 1247 external_mini_cluster.cc:1428] Setting key 56c15f7e326a0410f1bc3d21fc612cb8
I20260620 22:04:26.661187 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:26.653651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:56195 (local address 127.1.55.254:42625)
0620 22:04:26.653689 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:26.653690 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:26.653884 (+ 194us) server_negotiation.cc:407] Connection header received
0620 22:04:26.654252 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:26.654253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:26.654263 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:26.654310 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:26.655077 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.655511 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.656320 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.656476 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.656519 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:26.658492 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:26.658493 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:26.658493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:26.658498 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:26.659889 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:26.660297 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:26.660298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:26.660298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:26.660358 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:26.660635 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:26.660636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:26.660636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:26.660734 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:26.660802 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:26.661039 (+ 237us) server_negotiation.cc:299] Negotiation successful
0620 22:04:26.661106 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:04:26.661535 9790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:26.653628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:56195)
0620 22:04:26.653753 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:26.653806 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:26.654183 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:26.654355 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:26.654358 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:26.654839 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:26.655000 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:26.655003 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.655586 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.655586 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:26.656257 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:26.656259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.656550 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.656551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:26.656635 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:26.657215 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:26.657222 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:26.658420 (+ 1198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:26.659987 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:26.659994 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:26.659996 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:26.660208 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:26.660424 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:26.660424 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:26.660425 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:26.660539 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:26.660794 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:26.660799 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:26.660918 (+ 119us) client_negotiation.cc:769] Sending connection context
0620 22:04:26.661009 (+ 91us) client_negotiation.cc:240] Negotiation successful
0620 22:04:26.661149 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":74,"threads_started":1}
I20260620 22:04:26.661931 9788 heartbeater.cc:347] Connected to a master server at 127.1.55.254:42625
I20260620 22:04:26.662041 9788 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:26.662207 9788 heartbeater.cc:511] Master 127.1.55.254:42625 requested a full tablet report, sending...
I20260620 22:04:26.662559 9463 ts_manager.cc:194] Registered new tserver with Master: 871a5a6661e44a309e5a2a39bc761faf (127.1.55.194:41055)
I20260620 22:04:26.663060 9463 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:56195
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:04:26.683374 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42625
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:26.757908 9793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:26.758080 9793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:26.758102 9793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:26.759176 9793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:26.759215 9793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:26.759275 9793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:04:26.760636 9793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:42625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:26.760847 9793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:26.761049 9793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:26.765326 9799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.765326 9798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.765336 9801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:26.765657 9793 server_base.cc:1034] running on GCE node
I20260620 22:04:26.765797 9793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:26.765980 9793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:26.767107 9793 hybrid_clock.cc:648] HybridClock initialized: now 1781993066767096 us; error 25 us; skew 500 ppm
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:26.769454 9793 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:04:26.769847 9793 webserver.cc:460] Webserver started at http://127.1.55.195:38097/ using document root <none> and password file <none>
I20260620 22:04:26.770021 9793 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:26.770059 9793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:26.770141 9793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:26.771036 9793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "fad8639c140f4239a2a2fd341400e0b7"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "d3be5b8123d42445a201ad6b71e8033a"
server_key_iv: "99499703254f60764d151ca3a07fdd49"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.771282 9793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "fad8639c140f4239a2a2fd341400e0b7"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "d3be5b8123d42445a201ad6b71e8033a"
server_key_iv: "99499703254f60764d151ca3a07fdd49"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.772330 9793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:04:26.772857 9808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.773025 9793 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.773108 9793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "fad8639c140f4239a2a2fd341400e0b7"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "d3be5b8123d42445a201ad6b71e8033a"
server_key_iv: "99499703254f60764d151ca3a07fdd49"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.773177 9793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:26.795288 9793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:26.797211 9793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:26.797356 9793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:26.797573 9793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:26.797863 9793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:26.797914 9793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.797953 9793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:26.797982 9793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.803234 9793 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:45035
I20260620 22:04:26.803273 9921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:45035 every 8 connection(s)
I20260620 22:04:26.803522 9793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:04:26.807327 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 9793
I20260620 22:04:26.807461 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:04:26.807672 1247 external_mini_cluster.cc:1428] Setting key f99471ab09fe0e6f882b87415bc22910
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:04:26.812357 9502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:26.804116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:57445 (local address 127.1.55.254:42625)
0620 22:04:26.804154 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:26.804156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:26.804384 (+ 228us) server_negotiation.cc:407] Connection header received
0620 22:04:26.804839 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:26.804840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:26.804852 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:26.804894 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:26.805830 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.806343 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.807287 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.807617 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.807695 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:26.809753 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:26.809755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:26.809755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:26.809763 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:26.811129 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:26.811500 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:26.811501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:26.811502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:26.811551 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:26.811785 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:26.811786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:26.811786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:26.811889 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:26.811967 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:26.812208 (+ 241us) server_negotiation.cc:299] Negotiation successful
0620 22:04:26.812278 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:04:26.812497 9924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:26.804086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:57445)
0620 22:04:26.804263 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:26.804301 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:26.804738 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:26.804950 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:26.804953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:26.805575 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:26.805743 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:26.805747 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.806468 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.806469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:26.807201 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:26.807203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:26.807699 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:26.807700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:26.807824 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:26.808311 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:26.808318 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:26.809657 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:26.811220 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:26.811226 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:26.811228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:26.811417 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:26.811617 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:26.811618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:26.811619 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:26.811716 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:26.811957 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:26.811963 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:26.812085 (+ 122us) client_negotiation.cc:769] Sending connection context
0620 22:04:26.812175 (+ 90us) client_negotiation.cc:240] Negotiation successful
0620 22:04:26.812304 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260620 22:04:26.812891 9922 heartbeater.cc:347] Connected to a master server at 127.1.55.254:42625
I20260620 22:04:26.812965 9922 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:26.813151 9922 heartbeater.cc:511] Master 127.1.55.254:42625 requested a full tablet report, sending...
I20260620 22:04:26.813501 9463 ts_manager.cc:194] Registered new tserver with Master: fad8639c140f4239a2a2fd341400e0b7 (127.1.55.195:45035)
I20260620 22:04:26.813843 9463 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:57445
I20260620 22:04:26.819135 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab.
Entry for principal oryx/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab.
WARNING: no policy specified for oryx/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab.
Entry for principal oryx/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab.
WARNING: no policy specified for oryx/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab.
Entry for principal oryx/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab.
I20260620 22:04:26.877894 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 9525
I20260620 22:04:26.882472 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 9659
I20260620 22:04:26.886852 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 9793
I20260620 22:04:26.890738 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 9431
I20260620 22:04:26.895363 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42625
--webserver_interface=127.1.55.254
--webserver_port=44569
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:42625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:26.968036 9931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:26.968209 9931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:26.968228 9931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:26.969467 9931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:04:26.969525 9931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:26.969575 9931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:26.969604 9931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:04:26.969623 9931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:04:26.970997 9931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:42625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=44569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:26.971220 9931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:26.971418 9931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:26.975613 9936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.975611 9939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:26.975641 9937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:26.975780 9931 server_base.cc:1034] running on GCE node
I20260620 22:04:26.975991 9931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:26.976228 9931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:26.977358 9931 hybrid_clock.cc:648] HybridClock initialized: now 1781993066977343 us; error 29 us; skew 500 ppm
Jun 20 22:04:26 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993066, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:26.979633 9931 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:04:26.980016 9931 webserver.cc:460] Webserver started at http://127.1.55.254:44569/ using document root <none> and password file <none>
I20260620 22:04:26.980224 9931 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:26.980312 9931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:26.981403 9931 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:04:26.981997 9946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.982149 9931 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:26.982234 9931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "3ecaa5b2da5843a1bf28d936069f9e9d"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "e1d6b5485611af4f20e0925c591b413d"
server_key_iv: "adda41f17c0087d2217266601e99fc0c"
server_key_version: "encryptionkey@0"
I20260620 22:04:26.982492 9931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:27.021063 9931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:27.022815 9931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:27.022962 9931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:27.026420 9931 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:42625
I20260620 22:04:27.026451 9998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:42625 every 8 connection(s)
I20260620 22:04:27.026783 9931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:04:27.028053 9999 sys_catalog.cc:263] Verifying existing consensus state
I20260620 22:04:27.028609 9999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Bootstrap starting.
I20260620 22:04:27.029275 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 9931
I20260620 22:04:27.029595 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:42235
--local_ip_for_outbound_sockets=127.1.55.193
--tserver_master_addrs=127.1.55.254:42625
--webserver_port=45585
--webserver_interface=127.1.55.193
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.55.193
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:04:27.036808 9999 log.cc:824] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:27.038327 9999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:04:27.038591 9999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Bootstrap complete.
I20260620 22:04:27.040652 9999 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } }
I20260620 22:04:27.040835 9999 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ecaa5b2da5843a1bf28d936069f9e9d, State: Initialized, Role: FOLLOWER
I20260620 22:04:27.041010 9999 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } }
I20260620 22:04:27.041076 9999 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:04:27.041124 9999 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:04:27.041168 9999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 1 FOLLOWER]: Advancing to term 2
I20260620 22:04:27.042084 9999 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } }
I20260620 22:04:27.042182 9999 leader_election.cc:302] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ecaa5b2da5843a1bf28d936069f9e9d; no voters:
I20260620 22:04:27.042375 9999 leader_election.cc:288] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260620 22:04:27.042408 10003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 2 FOLLOWER]: Leader election won for term 2
I20260620 22:04:27.042514 10003 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [term 2 LEADER]: Becoming Leader. State: Replica: 3ecaa5b2da5843a1bf28d936069f9e9d, State: Running, Role: LEADER
I20260620 22:04:27.042590 10003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } }
I20260620 22:04:27.042616 9999 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:04:27.042855 10005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } } }
I20260620 22:04:27.042999 10005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:27.043264 10009 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:04:27.043300 10004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ecaa5b2da5843a1bf28d936069f9e9d. Latest consensus state: current_term: 2 leader_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ecaa5b2da5843a1bf28d936069f9e9d" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42625 } } }
I20260620 22:04:27.043385 10004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:27.043781 10009 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:04:27.044062 10009 catalog_manager.cc:1259] Loaded cluster ID: 0c37e17b5f70414d99f681df1afd93b7
I20260620 22:04:27.044108 10009 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:04:27.045203 10009 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:04:27.045343 10009 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3ecaa5b2da5843a1bf28d936069f9e9d: Loaded TSK: 0
I20260620 22:04:27.045552 10009 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 22:04:27.105073 10001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:27.105228 10001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:27.105248 10001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:27.106323 10001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:27.106357 10001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:27.106380 10001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:04:27.107643 10001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.193.keytab
--principal=oryx/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:42235
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=45585
--tserver_master_addrs=127.1.55.254:42625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:27.107841 10001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:27.108039 10001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:04:27.112461 10001 server_base.cc:1034] running on GCE node
W20260620 22:04:27.112416 10028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:27.112432 10026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:27.112421 10025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:27.112784 10001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:27.113024 10001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:27.114147 10001 hybrid_clock.cc:648] HybridClock initialized: now 1781993067114136 us; error 29 us; skew 500 ppm
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993067, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:27.116477 10001 init.cc:377] Logged in from keytab as oryx/127.1.55.193@KRBTEST.COM (short username oryx)
I20260620 22:04:27.116861 10001 webserver.cc:460] Webserver started at http://127.1.55.193:45585/ using document root <none> and password file <none>
I20260620 22:04:27.117063 10001 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:27.117116 10001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:27.118314 10001 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:27.118862 10035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.119024 10001 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:27.119102 10001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "9c3bea804412428e996ba11dec864627"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "ccae7f21485c86eb1feceb657d4ef1bf"
server_key_iv: "acb8cd078c311b7181b1c86970c39f3f"
server_key_version: "encryptionkey@0"
I20260620 22:04:27.119423 10001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:27.139213 10001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:27.141178 10001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:27.141290 10001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:27.141556 10001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:27.141847 10001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:27.141888 10001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.141906 10001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:27.141917 10001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.147976 10001 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:42235
I20260620 22:04:27.148084 10148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:42235 every 8 connection(s)
I20260620 22:04:27.148365 10001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:04:27.154130 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 10001
I20260620 22:04:27.154430 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:41055
--local_ip_for_outbound_sockets=127.1.55.194
--tserver_master_addrs=127.1.55.254:42625
--webserver_port=33717
--webserver_interface=127.1.55.194
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.55.194
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:27.156718 10151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.149003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:49101)
0620 22:04:27.149172 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.149210 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.149670 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.150108 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.150111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.150611 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.150773 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.150777 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.152243 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.152243 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.152917 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.152919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.153800 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.153801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.153884 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.154355 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.154364 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.156603 (+ 2239us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":86,"threads_started":1}
W20260620 22:04:27.156857 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.149079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:49101 (local address 127.1.55.254:42625)
0620 22:04:27.149277 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.149285 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.149315 (+ 30us) server_negotiation.cc:407] Connection header received
0620 22:04:27.149871 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.149878 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.149929 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.150072 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.150904 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.152153 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.153005 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.153716 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.153832 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.156714 (+ 2882us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:49101: BlockingRecv error: recv got EOF from 127.1.55.193:49101 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":85,"threads_started":1}
W20260620 22:04:27.156890 10149 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:42625 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.55.254:42625: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:27.161079 10151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.157303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:45403)
0620 22:04:27.157339 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.157350 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.157384 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.157542 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.157542 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.157658 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.157692 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.157693 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.158246 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.158247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.158744 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.158745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.159039 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.159040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.159097 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.159525 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.159529 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.161009 (+ 1480us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260620 22:04:27.161139 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.157332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:45403 (local address 127.1.55.254:42625)
0620 22:04:27.157385 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.157387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.157394 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:27.157431 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.157432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.157442 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.157538 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.157761 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.158164 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.158828 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.158980 (+ 152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.159041 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.161078 (+ 2037us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:45403: BlockingRecv error: recv got EOF from 127.1.55.193:45403 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:27.165035 10151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.161530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:56951)
0620 22:04:27.161559 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.161567 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.161608 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.161720 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.161721 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.161834 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.161854 (+ 20us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.161855 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.162397 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.162398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.162831 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.162832 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.163147 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.163148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.163193 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.163561 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.163565 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.164970 (+ 1405us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":20}
W20260620 22:04:27.165078 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.161553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:56951 (local address 127.1.55.254:42625)
0620 22:04:27.161588 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.161590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.161597 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:27.161658 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.161659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.161668 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.161717 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.161921 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.162318 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.162903 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.163068 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.163146 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.165027 (+ 1881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:56951: BlockingRecv error: recv got EOF from 127.1.55.193:56951 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260620 22:04:27.165349 10149 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 22:04:27.231353 10153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:27.231509 10153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:27.231555 10153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:27.232817 10153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:27.232872 10153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:27.232918 10153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:04:27.234292 10153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.194.keytab
--principal=oryx/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:41055
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=33717
--tserver_master_addrs=127.1.55.254:42625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:27.234500 10153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:27.234709 10153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:27.238931 10161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:27.238974 10159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:27.238945 10158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:27.239064 10153 server_base.cc:1034] running on GCE node
I20260620 22:04:27.239245 10153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:27.239487 10153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:27.240641 10153 hybrid_clock.cc:648] HybridClock initialized: now 1781993067240627 us; error 27 us; skew 500 ppm
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993067, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:27.242862 10153 init.cc:377] Logged in from keytab as oryx/127.1.55.194@KRBTEST.COM (short username oryx)
I20260620 22:04:27.243230 10153 webserver.cc:460] Webserver started at http://127.1.55.194:33717/ using document root <none> and password file <none>
I20260620 22:04:27.243434 10153 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:27.243481 10153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:27.244741 10153 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:27.245242 10168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.245384 10153 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.245460 10153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "871a5a6661e44a309e5a2a39bc761faf"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "7ceb755418402e3adb96170bd64b0692"
server_key_iv: "3b95c33fb9be2d3f60854987e5c2c358"
server_key_version: "encryptionkey@0"
I20260620 22:04:27.245749 10153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:27.266693 10153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:27.268172 10153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:27.268309 10153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:27.268500 10153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:27.268748 10153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:27.268810 10153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.268843 10153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:27.268867 10153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.274253 10153 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:41055
I20260620 22:04:27.274343 10281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:41055 every 8 connection(s)
I20260620 22:04:27.274588 10153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:27.279975 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 10153
I20260620 22:04:27.280289 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:45035
--local_ip_for_outbound_sockets=127.1.55.195
--tserver_master_addrs=127.1.55.254:42625
--webserver_port=38097
--webserver_interface=127.1.55.195
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:37873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.55.195
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:27.280653 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.275200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:51693 (local address 127.1.55.254:42625)
0620 22:04:27.275235 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.275237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.275389 (+ 152us) server_negotiation.cc:407] Connection header received
0620 22:04:27.275743 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.275744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.275754 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.275798 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.276483 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.276926 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.277831 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.277987 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.278038 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.280614 (+ 2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:51693: BlockingRecv error: recv got EOF from 127.1.55.194:51693 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:04:27.280721 10284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.275185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:51693)
0620 22:04:27.275307 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.275334 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.275675 (+ 341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.275839 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.275842 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.276267 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.276406 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.276409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.276996 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.276997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.277755 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.277757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.278054 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.278054 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.278137 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.278454 (+ 317us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.278461 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.280536 (+ 2075us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":73,"threads_started":1}
W20260620 22:04:27.280920 10282 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:42625 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.55.254:42625: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:27.285033 10284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.281122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:34737)
0620 22:04:27.281167 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.281176 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.281212 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.281313 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.281314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.281407 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.281444 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.281445 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.282066 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.282067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.282696 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.282697 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.283094 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.283094 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.283133 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.283523 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.283527 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.284989 (+ 1462us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260620 22:04:27.285159 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.281175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:34737 (local address 127.1.55.254:42625)
0620 22:04:27.281209 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.281211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.281218 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:27.281243 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.281244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.281252 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.281311 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.281548 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.281997 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.282767 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.283030 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.283092 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.285081 (+ 1989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:34737: BlockingRecv error: recv got EOF from 127.1.55.194:34737 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:27.289635 10284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.285392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:46923)
0620 22:04:27.285432 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.285440 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.285491 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.285625 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.285626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.285763 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.285794 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.285796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.286350 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.286351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.287126 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.287129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.287434 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.287435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.287488 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.287833 (+ 345us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.287838 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.289564 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260620 22:04:27.289683 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.285427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:46923 (local address 127.1.55.254:42625)
0620 22:04:27.285457 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.285459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.285467 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:04:27.285547 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.285548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.285558 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.285602 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.285908 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.286282 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.287216 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.287367 (+ 151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.287414 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.289626 (+ 2212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:46923: BlockingRecv error: recv got EOF from 127.1.55.194:46923 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260620 22:04:27.289817 10282 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 22:04:27.354125 10285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:27.354317 10285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:27.354349 10285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:27.355409 10285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:27.355472 10285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:27.355517 10285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:04:27.356799 10285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/krb5kdc/oryx_127.1.55.195.keytab
--principal=oryx/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:45035
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=38097
--tserver_master_addrs=127.1.55.254:42625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:27.357021 10285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:27.357236 10285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:27.361581 10293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:27.361722 10285 server_base.cc:1034] running on GCE node
W20260620 22:04:27.361599 10291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:27.361802 10290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:27.361990 10285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:27.362210 10285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:27.363339 10285 hybrid_clock.cc:648] HybridClock initialized: now 1781993067363330 us; error 25 us; skew 500 ppm
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993067, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:27.365350 10285 init.cc:377] Logged in from keytab as oryx/127.1.55.195@KRBTEST.COM (short username oryx)
I20260620 22:04:27.365789 10285 webserver.cc:460] Webserver started at http://127.1.55.195:38097/ using document root <none> and password file <none>
I20260620 22:04:27.365976 10285 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:27.366044 10285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:27.367152 10285 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:04:27.367712 10300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.367956 10285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:04:27.368047 10285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "fad8639c140f4239a2a2fd341400e0b7"
format_stamp: "Formatted at 2026-06-20 22:04:26 on dist-test-slave-xw35"
server_key: "d3be5b8123d42445a201ad6b71e8033a"
server_key_iv: "99499703254f60764d151ca3a07fdd49"
server_key_version: "encryptionkey@0"
I20260620 22:04:27.368333 10285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:27.383577 10285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:27.385239 10285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:27.385375 10285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:27.385627 10285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:27.385875 10285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:27.385922 10285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.385957 10285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:27.385999 10285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:27.391392 10285 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:45035
I20260620 22:04:27.391429 10413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:45035 every 8 connection(s)
I20260620 22:04:27.391737 10285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:04:27.394948 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 10285
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
W20260620 22:04:27.398154 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.392347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:45451 (local address 127.1.55.254:42625)
0620 22:04:27.392391 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.392393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.392550 (+ 157us) server_negotiation.cc:407] Connection header received
0620 22:04:27.392911 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.392912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.392920 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.392964 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.393697 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.394123 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.394930 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.395199 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.395284 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.398089 (+ 2805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:45451: BlockingRecv error: recv got EOF from 127.1.55.195:45451 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:04:27.398336 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.392313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:45451)
0620 22:04:27.392439 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.392472 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.392839 (+ 367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.393012 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.393015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.393455 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.393630 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.393634 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.394190 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.394190 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.394854 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.394855 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.395306 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.395307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.395432 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.395909 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.395916 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.398020 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":75,"threads_started":1}
W20260620 22:04:27.398592 10414 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:42625 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.55.254:42625: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:27.403002 10418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.395415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60076 (local address 127.1.55.254:42625)
0620 22:04:27.395525 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.395527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.395536 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:04:27.395556 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.395556 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.395567 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.395643 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.396262 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.396837 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.397812 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.398094 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.398160 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.399489 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:27.399493 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:27.399493 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:27.399504 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:27.401524 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:27.401887 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:27.401889 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:27.401890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:27.402021 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:27.402216 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:27.402217 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:27.402217 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:27.402489 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:27.402591 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:27.402801 (+ 210us) server_negotiation.cc:299] Negotiation successful
0620 22:04:27.402903 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":51,"threads_started":1}
I20260620 22:04:27.403359 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.398829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:51393)
0620 22:04:27.398936 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.398946 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.399007 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.399145 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.399145 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.399281 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.399330 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.399331 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.400155 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.400156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.400625 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.400626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.401038 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.401039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.401079 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.401453 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.401456 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.403289 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":91}
W20260620 22:04:27.403403 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.398871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:51393 (local address 127.1.55.254:42625)
0620 22:04:27.398901 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.398902 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.399004 (+ 102us) server_negotiation.cc:407] Connection header received
0620 22:04:27.399063 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.399063 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.399070 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.399116 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.399397 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.400080 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.400700 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.400965 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.401036 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.403349 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:51393: BlockingRecv error: recv got EOF from 127.1.55.195:51393 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:27 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:27.407217 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:27.403632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:37695)
0620 22:04:27.403707 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:27.403717 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:27.403758 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:27.403902 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:27.403903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:27.404027 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:27.404050 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.404051 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.404569 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.404569 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.405014 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:27.405015 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.405293 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.405294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:27.405326 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.405739 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:27.405743 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:27.407181 (+ 1438us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260620 22:04:27.407325 10414 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 22:04:27.407330 10152 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:27.403668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:37695 (local address 127.1.55.254:42625)
0620 22:04:27.403710 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:27.403712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:27.403748 (+ 36us) server_negotiation.cc:407] Connection header received
0620 22:04:27.403823 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:27.403824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:27.403832 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:27.403880 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:27.404103 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.404510 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.405078 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:27.405233 (+ 155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:27.405278 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:27.407262 (+ 1984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:37695: BlockingRecv error: recv got EOF from 127.1.55.195:37695 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Jun 20 22:04:28 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:28 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:28.170023 10419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:28.165685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:53089)
0620 22:04:28.165800 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:28.165814 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:28.165856 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:28.166021 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:28.166022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:28.166167 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:28.166211 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:28.166213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.166802 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.166802 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:28.167325 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:28.167327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.167687 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.167688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:28.167724 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:28.168152 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:28.168157 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:28.169924 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":71,"threads_started":1}
W20260620 22:04:28.170082 10420 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:28.165757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:53089 (local address 127.1.55.254:42625)
0620 22:04:28.165886 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:28.165887 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:28.165894 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:28.165912 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:28.165913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:28.165922 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:28.166019 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:28.166271 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.166751 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.167388 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.167615 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.167678 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:28.169997 (+ 2319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:53089: BlockingRecv error: recv got EOF from 127.1.55.193:53089 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":78,"threads_started":1}
Jun 20 22:04:28 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:28 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:28.294617 10421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:28.290140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:46659)
0620 22:04:28.290303 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:28.290314 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:28.290360 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:28.290688 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:28.290689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:28.290913 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:28.290972 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:28.290974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.291626 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.291627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:28.292134 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:28.292135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.292428 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.292429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:28.292465 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:28.292916 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:28.292920 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:28.294551 (+ 1631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
W20260620 22:04:28.294723 10420 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:28.290258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:46659 (local address 127.1.55.254:42625)
0620 22:04:28.290333 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:28.290335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:28.290363 (+ 28us) server_negotiation.cc:407] Connection header received
0620 22:04:28.290433 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:28.290434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:28.290444 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:28.290531 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:28.291062 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.291557 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.292202 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.292372 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.292418 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:28.294646 (+ 2228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:46659: BlockingRecv error: recv got EOF from 127.1.55.194:46659 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Jun 20 22:04:28 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:28 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:28.411960 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:28.407721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:52755)
0620 22:04:28.407855 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:28.407866 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:28.407918 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:28.408074 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:28.408075 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:28.408267 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:28.408321 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:28.408323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.408995 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.408996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:28.409564 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:28.409566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.409873 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.409873 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:28.409910 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:28.410341 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:28.410346 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:28.411903 (+ 1557us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
W20260620 22:04:28.412067 10420 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:28.407817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:52755 (local address 127.1.55.254:42625)
0620 22:04:28.407891 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:28.407893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:28.407905 (+ 12us) server_negotiation.cc:407] Connection header received
0620 22:04:28.407981 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:28.407982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:28.407994 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:28.408056 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:28.408404 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.408931 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.409635 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:28.409811 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:28.409861 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:28.411979 (+ 2118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:52755: BlockingRecv error: recv got EOF from 127.1.55.195:52755 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Jun 20 22:04:29 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:29 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:29.174582 10423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:29.170413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:53035)
0620 22:04:29.170572 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:29.170582 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:29.170663 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:29.170789 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:29.170789 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:29.170926 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:29.170973 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:29.170974 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.171649 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.171650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:29.172128 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:29.172129 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.172426 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.172427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:29.172466 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:29.172854 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:29.172858 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:29.174478 (+ 1620us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
W20260620 22:04:29.174644 10424 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:29.170474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:53035 (local address 127.1.55.254:42625)
0620 22:04:29.170637 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:29.170639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:29.170646 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:29.170705 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:29.170705 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:29.170722 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:29.170774 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:29.171027 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.171545 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.172205 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.172367 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.172412 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:29.174541 (+ 2129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:53035: BlockingRecv error: recv got EOF from 127.1.55.193:53035 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
Jun 20 22:04:29 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:29 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:29.299382 10425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:29.295054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:49895)
0620 22:04:29.295200 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:29.295209 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:29.295282 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:29.295431 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:29.295432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:29.295586 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:29.295626 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:29.295628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.296235 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.296236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:29.296745 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:29.296747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.297119 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.297120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:29.297180 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:29.297648 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:29.297652 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:29.299325 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
W20260620 22:04:29.299448 10424 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:29.295113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:49895 (local address 127.1.55.254:42625)
0620 22:04:29.295179 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:29.295181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:29.295268 (+ 87us) server_negotiation.cc:407] Connection header received
0620 22:04:29.295330 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:29.295331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:29.295342 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:29.295426 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:29.295700 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.296158 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.296826 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.297015 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.297101 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:29.299406 (+ 2305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:49895: BlockingRecv error: recv got EOF from 127.1.55.194:49895 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Jun 20 22:04:29 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:29 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:29.416477 10426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:29.412347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:58525)
0620 22:04:29.412507 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:29.412519 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:29.412599 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:29.412768 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:29.412769 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:29.412917 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:29.412957 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:29.412959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.413586 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.413587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:29.414060 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:29.414062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.414422 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.414423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:29.414483 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:29.414877 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:29.414881 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:29.416395 (+ 1514us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":106,"threads_started":1}
W20260620 22:04:29.416510 10424 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:29.412588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:58525 (local address 127.1.55.254:42625)
0620 22:04:29.412656 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:29.412657 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:29.412664 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:29.412684 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:29.412684 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:29.412695 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:29.412763 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:29.413027 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.413511 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.414156 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:29.414344 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:29.414421 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:29.416456 (+ 2035us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:58525: BlockingRecv error: recv got EOF from 127.1.55.195:58525 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Jun 20 22:04:30 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:30 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:30.179183 10427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:30.175044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:41149)
0620 22:04:30.175152 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:30.175163 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:30.175227 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:30.175350 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:30.175351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:30.175487 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:30.175532 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:30.175534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.176152 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.176153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:30.176661 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:30.176662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.176963 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.176964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:30.176998 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:30.177412 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:30.177416 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:30.179123 (+ 1707us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":52,"threads_started":1}
W20260620 22:04:30.179316 10428 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:30.175121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:41149 (local address 127.1.55.254:42625)
0620 22:04:30.175243 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:30.175245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:30.175252 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:30.175271 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:30.175271 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:30.175281 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:30.175333 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:30.175595 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.176087 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.176724 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.176909 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.176955 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:30.179209 (+ 2254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:41149: BlockingRecv error: recv got EOF from 127.1.55.193:41149 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
Jun 20 22:04:30 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:30 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:30.304287 10429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:30.299851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:43159)
0620 22:04:30.300031 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:30.300047 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:30.300120 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:30.300279 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:30.300280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:30.300449 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:30.300493 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:30.300494 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.301135 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.301136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:30.301709 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:30.301711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.302048 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.302049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:30.302131 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:30.302552 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:30.302556 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:30.304193 (+ 1637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":79,"threads_started":1}
W20260620 22:04:30.304320 10428 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:30.299886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:43159 (local address 127.1.55.254:42625)
0620 22:04:30.299929 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:30.299931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:30.300103 (+ 172us) server_negotiation.cc:407] Connection header received
0620 22:04:30.300185 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:30.300185 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:30.300198 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:30.300270 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:30.300603 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.301060 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.301788 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.301966 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.302043 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:30.304263 (+ 2220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:43159: BlockingRecv error: recv got EOF from 127.1.55.194:43159 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Jun 20 22:04:30 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:30 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:30.421419 10430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:30.416985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:47753)
0620 22:04:30.417140 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:30.417149 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:30.417211 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:30.417344 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:30.417345 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:30.417578 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:30.417630 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:30.417632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.418288 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.418289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:30.418826 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:30.418828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.419189 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.419189 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:30.419244 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:30.419689 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:30.419693 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:30.421308 (+ 1615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":78,"threads_started":1}
W20260620 22:04:30.421458 10428 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:30.417069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:47753 (local address 127.1.55.254:42625)
0620 22:04:30.417134 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:30.417136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:30.417194 (+ 58us) server_negotiation.cc:407] Connection header received
0620 22:04:30.417260 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:30.417260 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:30.417273 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:30.417338 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:30.417708 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.418194 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.418904 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:30.419089 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:30.419177 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:30.421376 (+ 2199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:47753: BlockingRecv error: recv got EOF from 127.1.55.195:47753 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Jun 20 22:04:31 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:31 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:31.183693 10431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:31.179643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:45437)
0620 22:04:31.179800 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:31.179810 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:31.179861 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:31.180006 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:31.180006 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:31.180159 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:31.180206 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:31.180207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.180845 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.180846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:31.181313 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:31.181314 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.181619 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.181620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:31.181654 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:31.182130 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:31.182134 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:31.183642 (+ 1508us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
W20260620 22:04:31.183830 10432 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:31.179751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:45437 (local address 127.1.55.254:42625)
0620 22:04:31.179879 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:31.179881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:31.179891 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:04:31.179921 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:31.179922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:31.179931 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:31.179990 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:31.180273 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.180780 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.181386 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.181565 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.181611 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:31.183745 (+ 2134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:45437: BlockingRecv error: recv got EOF from 127.1.55.193:45437 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
Jun 20 22:04:31 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:31 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:31.308864 10433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:31.304745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:57515)
0620 22:04:31.304857 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:31.304873 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:31.304921 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:31.305016 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:31.305017 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:31.305149 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:31.305190 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:31.305191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.305839 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.305841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:31.306338 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:31.306339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.306652 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.306652 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:31.306690 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:31.307180 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:31.307184 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:31.308817 (+ 1633us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":72,"threads_started":1}
W20260620 22:04:31.309028 10432 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:31.304797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:57515 (local address 127.1.55.254:42625)
0620 22:04:31.304861 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:31.304863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:31.304920 (+ 57us) server_negotiation.cc:407] Connection header received
0620 22:04:31.304960 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:31.304961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:31.304968 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:31.305013 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:31.305268 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.305773 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.306402 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.306591 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.306639 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:31.308955 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:57515: BlockingRecv error: recv got EOF from 127.1.55.194:57515 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Jun 20 22:04:31 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:31 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:31.426118 10434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:31.421862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:37857)
0620 22:04:31.421994 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:31.422003 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:31.422071 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:31.422202 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:31.422203 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:31.422346 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:31.422384 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:31.422385 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.422959 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.422960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:31.423443 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:31.423445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.423837 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.423838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:31.423896 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:31.424398 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:31.424403 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:31.426037 (+ 1634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
W20260620 22:04:31.426164 10432 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:31.421912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:37857 (local address 127.1.55.254:42625)
0620 22:04:31.421961 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:31.421963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:31.422056 (+ 93us) server_negotiation.cc:407] Connection header received
0620 22:04:31.422148 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:31.422149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:31.422159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:31.422199 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:31.422457 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.422889 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.423554 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:31.423755 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:31.423836 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:31.426098 (+ 2262us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:37857: BlockingRecv error: recv got EOF from 127.1.55.195:37857 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Jun 20 22:04:32 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:32 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:32.192977 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:32.184094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:53237)
0620 22:04:32.184232 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:32.184243 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:32.184305 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:32.184428 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:32.184429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:32.184569 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:32.184617 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:32.184618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.185242 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.185243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:32.185828 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:32.185830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.186155 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.186155 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:32.186189 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:32.191147 (+ 4958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:32.191152 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:32.192925 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":61,"threads_started":1}
W20260620 22:04:32.193112 10436 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:32.184136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:53237 (local address 127.1.55.254:42625)
0620 22:04:32.184262 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:32.184264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:32.184290 (+ 26us) server_negotiation.cc:407] Connection header received
0620 22:04:32.184354 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:32.184354 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:32.184363 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:32.184418 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:32.184693 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.185173 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.185886 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.186095 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.186146 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:32.193024 (+ 6878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:53237: BlockingRecv error: recv got EOF from 127.1.55.193:53237 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
Jun 20 22:04:32 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:32 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:32.313735 10437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:32.309424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:36429)
0620 22:04:32.309626 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:32.309637 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:32.309732 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:32.309873 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:32.309874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:32.310057 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:32.310103 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:32.310105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.310692 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.310693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:32.311196 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:32.311197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.311510 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.311511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:32.311579 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:32.311961 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:32.311965 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:32.313681 (+ 1716us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":94,"threads_started":1}
W20260620 22:04:32.313860 10436 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:32.309508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:36429 (local address 127.1.55.254:42625)
0620 22:04:32.309551 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:32.309552 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:32.309750 (+ 198us) server_negotiation.cc:407] Connection header received
0620 22:04:32.309781 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:32.309782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:32.309794 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:32.309850 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:32.310170 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.310630 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.311261 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.311435 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.311479 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:32.313786 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:36429: BlockingRecv error: recv got EOF from 127.1.55.194:36429 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Jun 20 22:04:32 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:32 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:32.430986 10438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:32.426681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:52099)
0620 22:04:32.426819 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:32.426832 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:32.426887 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:32.426991 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:32.426992 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:32.427131 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:32.427173 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:32.427175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.427981 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.427982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:32.428495 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:32.428497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.428807 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.428808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:32.428844 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:32.429246 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:32.429250 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:32.430899 (+ 1649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
W20260620 22:04:32.431033 10436 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:32.426729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:52099 (local address 127.1.55.254:42625)
0620 22:04:32.426804 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:32.426805 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:32.426893 (+ 88us) server_negotiation.cc:407] Connection header received
0620 22:04:32.426928 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:32.426929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:32.426938 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:32.426987 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:32.427238 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.427918 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.428565 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:32.428737 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:32.428796 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:32.430969 (+ 2173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:52099: BlockingRecv error: recv got EOF from 127.1.55.195:52099 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Jun 20 22:04:33 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:33 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:33.197769 10439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:33.193412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:52599)
0620 22:04:33.193571 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:33.193598 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:33.193681 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:33.193860 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:33.193861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:33.194006 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:33.194066 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:33.194067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.194671 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.194671 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:33.195175 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:33.195176 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.195466 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.195467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:33.195501 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:33.195903 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:33.195907 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:33.197718 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":108,"threads_started":1}
W20260620 22:04:33.197903 10440 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:33.193445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:52599 (local address 127.1.55.254:42625)
0620 22:04:33.193584 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:33.193586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:33.193694 (+ 108us) server_negotiation.cc:407] Connection header received
0620 22:04:33.193767 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:33.193768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:33.193784 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:33.193840 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:33.194130 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.194603 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.195241 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.195407 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.195454 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:33.197816 (+ 2362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:52599: BlockingRecv error: recv got EOF from 127.1.55.193:52599 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":94,"threads_started":1}
Jun 20 22:04:33 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:33 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:33.318326 10441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:33.314131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:34633)
0620 22:04:33.314263 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:33.314273 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:33.314331 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:33.314454 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:33.314454 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:33.314617 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:33.314660 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:33.314662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.315314 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.315315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:33.315802 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:33.315804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.316136 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.316137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:33.316195 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:33.316697 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:33.316701 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:33.318279 (+ 1578us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
W20260620 22:04:33.318445 10440 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:33.314231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:34633 (local address 127.1.55.254:42625)
0620 22:04:33.314288 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:33.314290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:33.314318 (+ 28us) server_negotiation.cc:407] Connection header received
0620 22:04:33.314381 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:33.314381 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:33.314390 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:33.314437 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:33.314755 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.315232 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.315885 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.316068 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.316139 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:33.318373 (+ 2234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:34633: BlockingRecv error: recv got EOF from 127.1.55.194:34633 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Jun 20 22:04:33 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:33 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:33.435423 10442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:33.431409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:58891)
0620 22:04:33.431538 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:33.431549 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:33.431606 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:33.431736 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:33.431737 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:33.431896 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:33.431937 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:33.431938 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.432507 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.432508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:33.432960 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:33.432962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.433288 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.433289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:33.433343 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:33.433710 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:33.433714 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:33.435343 (+ 1629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":68,"threads_started":1}
W20260620 22:04:33.435467 10440 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:33.431516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:58891 (local address 127.1.55.254:42625)
0620 22:04:33.431558 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:33.431560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:33.431591 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:04:33.431652 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:33.431653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:33.431664 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:33.431720 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:33.432005 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.432432 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.433034 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:33.433211 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:33.433287 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:33.435408 (+ 2121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:58891: BlockingRecv error: recv got EOF from 127.1.55.195:58891 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Jun 20 22:04:34 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:34 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:34.202363 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:34.198155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:46447)
0620 22:04:34.198284 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:34.198293 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:34.198336 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:34.198459 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:34.198459 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:34.198596 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:34.198648 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:34.198650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.199212 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.199212 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:34.199679 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:34.199680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.199994 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.199995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:34.200033 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:34.200511 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:34.200516 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:34.202310 (+ 1794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":70,"threads_started":1}
W20260620 22:04:34.202520 10444 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:34.198211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:46447 (local address 127.1.55.254:42625)
0620 22:04:34.198328 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:34.198330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:34.198338 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:04:34.198378 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:34.198378 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:34.198387 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:34.198441 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:34.198704 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.199155 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.199756 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.199936 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.199983 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:34.202426 (+ 2443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:46447: BlockingRecv error: recv got EOF from 127.1.55.193:46447 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":70,"threads_started":1}
Jun 20 22:04:34 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:34 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:34.323148 10445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:34.318761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:56903)
0620 22:04:34.318902 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:34.318911 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:34.318982 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:34.319143 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:34.319144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:34.319285 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:34.319325 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:34.319327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.319961 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.319962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:34.320481 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:34.320482 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.320868 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.320869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:34.320939 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:34.321415 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:34.321419 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:34.323060 (+ 1641us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":60,"threads_started":1}
W20260620 22:04:34.323206 10444 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:34.318808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:56903 (local address 127.1.55.254:42625)
0620 22:04:34.318868 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:34.318870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:34.318966 (+ 96us) server_negotiation.cc:407] Connection header received
0620 22:04:34.319059 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:34.319059 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:34.319075 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:34.319129 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:34.319396 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.319873 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.320574 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.320767 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.320853 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:34.323140 (+ 2287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:56903: BlockingRecv error: recv got EOF from 127.1.55.194:56903 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Jun 20 22:04:34 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:34 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:34.439944 10446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:34.435967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:34861)
0620 22:04:34.436091 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:34.436116 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:34.436170 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:34.436281 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:34.436281 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:34.436409 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:34.436450 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:34.436451 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.436999 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.437000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:34.437556 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:34.437558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.437835 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.437836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:34.437871 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:34.438262 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:34.438266 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:34.439856 (+ 1590us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
W20260620 22:04:34.439985 10444 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:34.436054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:34861 (local address 127.1.55.254:42625)
0620 22:04:34.436097 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:34.436099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:34.436175 (+ 76us) server_negotiation.cc:407] Connection header received
0620 22:04:34.436209 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:34.436210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:34.436220 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:34.436262 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:34.436519 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.436944 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.437625 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:34.437781 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:34.437826 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:34.439925 (+ 2099us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:34861: BlockingRecv error: recv got EOF from 127.1.55.195:34861 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Jun 20 22:04:35 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:35 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:35.206947 10447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:35.202885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:38513)
0620 22:04:35.203027 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:35.203039 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:35.203121 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:35.203273 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:35.203274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:35.203410 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:35.203456 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:35.203458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.204007 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.204008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:35.204475 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:35.204476 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.204795 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.204796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:35.204830 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:35.205211 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:35.205214 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:35.206856 (+ 1642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":65,"threads_started":1}
W20260620 22:04:35.206996 10448 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:35.202994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:38513 (local address 127.1.55.254:42625)
0620 22:04:35.203121 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:35.203123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:35.203130 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:04:35.203184 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:35.203184 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:35.203193 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:35.203257 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:35.203513 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.203955 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.204535 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.204738 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.204786 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:35.206928 (+ 2142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:38513: BlockingRecv error: recv got EOF from 127.1.55.193:38513 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
Jun 20 22:04:35 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:35 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:35.327692 10449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:35.323548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:37175)
0620 22:04:35.323703 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:35.323712 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:35.323765 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:35.323890 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:35.323890 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:35.324024 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:35.324066 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:35.324067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.324785 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.324785 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:35.325336 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:35.325337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.325674 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.325674 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:35.325711 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:35.326133 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:35.326137 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:35.327630 (+ 1493us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":107,"threads_started":1}
W20260620 22:04:35.327777 10448 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:35.323592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:37175 (local address 127.1.55.254:42625)
0620 22:04:35.323659 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:35.323661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:35.323767 (+ 106us) server_negotiation.cc:407] Connection header received
0620 22:04:35.323804 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:35.323805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:35.323814 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:35.323876 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:35.324127 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.324710 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.325401 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.325618 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.325668 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:35.327714 (+ 2046us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:37175: BlockingRecv error: recv got EOF from 127.1.55.194:37175 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Jun 20 22:04:35 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:35 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:35.444479 10450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:35.440380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:41693)
0620 22:04:35.440538 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:35.440548 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:35.440605 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:35.440738 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:35.440739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:35.440878 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:35.440923 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:35.440925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.441544 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.441545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:35.442075 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:35.442076 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.442391 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.442392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:35.442430 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:35.442817 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:35.442822 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:35.444435 (+ 1613us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":95,"threads_started":1}
W20260620 22:04:35.444697 10448 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:35.440434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:41693 (local address 127.1.55.254:42625)
0620 22:04:35.440495 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:35.440497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:35.440607 (+ 110us) server_negotiation.cc:407] Connection header received
0620 22:04:35.440670 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:35.440671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:35.440682 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:35.440720 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:35.440980 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.441449 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.442137 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:35.442316 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:35.442398 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:35.444515 (+ 2117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:41693: BlockingRecv error: recv got EOF from 127.1.55.195:41693 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Jun 20 22:04:36 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:36 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:36.211642 10451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:36.207383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:42137)
0620 22:04:36.207502 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:36.207520 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:36.207579 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:36.207719 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:36.207719 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:36.207866 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:36.207913 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:36.207914 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.208508 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.208509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:36.209007 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:36.209008 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.209311 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.209312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:36.209347 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:36.209848 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:36.209852 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:36.211590 (+ 1738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
W20260620 22:04:36.211743 10452 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:36.207428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:42137 (local address 127.1.55.254:42625)
0620 22:04:36.207558 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:36.207560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:36.207569 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:04:36.207642 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:36.207643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:36.207653 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:36.207713 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:36.207968 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.208448 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.209069 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.209242 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.209286 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:36.211673 (+ 2387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:42137: BlockingRecv error: recv got EOF from 127.1.55.193:42137 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
Jun 20 22:04:36 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:36 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:36.332599 10453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:36.328112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:51327)
0620 22:04:36.328229 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:36.328238 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:36.328311 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:36.328472 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:36.328472 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:36.328633 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:36.328679 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:36.328680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.329320 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.329322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:36.329986 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:36.329988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.330354 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.330354 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:36.330413 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:36.330877 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:36.330881 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:36.332510 (+ 1629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":68,"threads_started":1}
W20260620 22:04:36.332655 10452 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:36.328220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:51327 (local address 127.1.55.254:42625)
0620 22:04:36.328286 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:36.328288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:36.328296 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:04:36.328384 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:36.328385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:36.328396 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:36.328467 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:36.328764 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.329241 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.330075 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.330270 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.330352 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:36.332586 (+ 2234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:51327: BlockingRecv error: recv got EOF from 127.1.55.194:51327 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Jun 20 22:04:36 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:36 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:36.449255 10454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:36.444993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:54081)
0620 22:04:36.445138 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:36.445147 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:36.445195 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:36.445289 (+ 94us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:36.445290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:36.445426 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:36.445512 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:36.445514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.446100 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.446101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:36.446578 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:36.446580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.446852 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.446852 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:36.446885 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:36.447377 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:36.447381 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:36.449193 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
W20260620 22:04:36.449366 10452 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:36.445040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:54081 (local address 127.1.55.254:42625)
0620 22:04:36.445092 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:36.445094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:36.445197 (+ 103us) server_negotiation.cc:407] Connection header received
0620 22:04:36.445230 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:36.445230 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:36.445240 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:36.445284 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:36.445586 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.446042 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.446643 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:36.446797 (+ 154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:36.446841 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:36.449273 (+ 2432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:54081: BlockingRecv error: recv got EOF from 127.1.55.195:54081 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Jun 20 22:04:37 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:37 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:37.220130 10455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:37.212097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:50593)
0620 22:04:37.212228 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:37.212239 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:37.212283 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:37.212422 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:37.212423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:37.212570 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:37.212621 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:37.212622 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.213254 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.213254 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:37.213812 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:37.213814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.214136 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.214137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:37.214173 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:37.218429 (+ 4256us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:37.218433 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:37.220067 (+ 1634us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
W20260620 22:04:37.220273 10456 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:37.212166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:50593 (local address 127.1.55.254:42625)
0620 22:04:37.212298 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:37.212300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:37.212315 (+ 15us) server_negotiation.cc:407] Connection header received
0620 22:04:37.212335 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:37.212336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:37.212345 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:37.212404 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:37.212687 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.213192 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.213887 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.214072 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.214126 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:37.220184 (+ 6058us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:50593: BlockingRecv error: recv got EOF from 127.1.55.193:50593 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
Jun 20 22:04:37 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:37 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:37.336970 10457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:37.333030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:43923)
0620 22:04:37.333155 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:37.333163 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:37.333211 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:37.333323 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:37.333324 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:37.333456 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:37.333542 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:37.333544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.334108 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.334108 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:37.334576 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:37.334577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.334863 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.334864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:37.334898 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:37.335312 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:37.335316 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:37.336910 (+ 1594us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
W20260620 22:04:37.337077 10456 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:37.333098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:43923 (local address 127.1.55.254:42625)
0620 22:04:37.333144 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:37.333146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:37.333200 (+ 54us) server_negotiation.cc:407] Connection header received
0620 22:04:37.333250 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:37.333250 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:37.333258 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:37.333305 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:37.333608 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.334048 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.334642 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.334805 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.334853 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:37.336986 (+ 2133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:43923: BlockingRecv error: recv got EOF from 127.1.55.194:43923 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Jun 20 22:04:37 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:37 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:37.453971 10458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:37.449661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:50279)
0620 22:04:37.449772 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:37.449803 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:37.449857 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:37.450007 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:37.450008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:37.450187 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:37.450229 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:37.450230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.450878 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.450879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:37.451417 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:37.451420 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.451722 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.451723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:37.451773 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:37.452144 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:37.452148 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:37.453889 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":66,"threads_started":1}
W20260620 22:04:37.454007 10456 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:37.449753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:50279 (local address 127.1.55.254:42625)
0620 22:04:37.449836 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:37.449838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:37.449847 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:04:37.449917 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:37.449918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:37.449932 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:37.449999 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:37.450306 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.450793 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.451502 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:37.451660 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:37.451724 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:37.453952 (+ 2228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:50279: BlockingRecv error: recv got EOF from 127.1.55.195:50279 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Jun 20 22:04:38 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:38 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:38.225051 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:38.220578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:50421)
0620 22:04:38.220730 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:38.220741 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:38.220799 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:38.220929 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:38.220929 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:38.221081 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:38.221127 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:38.221129 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.221971 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.221973 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:38.222529 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:38.222532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.222878 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.222880 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:38.222934 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:38.223355 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:38.223359 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:38.224988 (+ 1629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":104,"threads_started":1}
W20260620 22:04:38.225178 10460 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:38.220641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:50421 (local address 127.1.55.254:42625)
0620 22:04:38.220768 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:38.220771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:38.220788 (+ 17us) server_negotiation.cc:407] Connection header received
0620 22:04:38.220842 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:38.220843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:38.220853 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:38.220911 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:38.221194 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.221877 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.222623 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.222808 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.222877 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:38.225072 (+ 2195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:50421: BlockingRecv error: recv got EOF from 127.1.55.193:50421 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":76,"threads_started":1}
Jun 20 22:04:38 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:38 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:38.341738 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:38.337442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:48627)
0620 22:04:38.337631 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:38.337640 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:38.337689 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:38.337821 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:38.337822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:38.337986 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:38.338027 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:38.338029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.338590 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.338590 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:38.339060 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:38.339061 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.339466 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.339467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:38.339526 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:38.339922 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:38.339926 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:38.341680 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":130,"threads_started":1}
W20260620 22:04:38.341837 10460 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:38.337533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:48627 (local address 127.1.55.254:42625)
0620 22:04:38.337581 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:38.337582 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:38.337692 (+ 110us) server_negotiation.cc:407] Connection header received
0620 22:04:38.337745 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:38.337746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:38.337755 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:38.337803 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:38.338099 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.338527 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.339118 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.339392 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.339453 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:38.341756 (+ 2303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:48627: BlockingRecv error: recv got EOF from 127.1.55.194:48627 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Jun 20 22:04:38 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:38 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:38.459210 10462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:38.454406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:45021)
0620 22:04:38.454588 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:38.454599 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:38.454683 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:38.454826 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:38.454827 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:38.455004 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:38.455045 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:38.455047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.455686 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.455687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:38.456593 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:38.456595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.457007 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.457008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:38.457098 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:38.457614 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:38.457619 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:38.459151 (+ 1532us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":93,"threads_started":1}
W20260620 22:04:38.459276 10460 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:38.454489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:45021 (local address 127.1.55.254:42625)
0620 22:04:38.454573 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:38.454575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:38.454665 (+ 90us) server_negotiation.cc:407] Connection header received
0620 22:04:38.454742 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:38.454743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:38.454769 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:38.454821 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:38.455132 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.455604 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.456659 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:38.456902 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:38.456964 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:38.459233 (+ 2269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:45021: BlockingRecv error: recv got EOF from 127.1.55.195:45021 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Jun 20 22:04:39 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:39 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:39.229815 10463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:39.225577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:57537)
0620 22:04:39.225694 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:39.225709 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:39.225781 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:39.225958 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:39.225958 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:39.226150 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:39.226201 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:39.226203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.226763 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.226764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:39.227242 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:39.227243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.227531 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.227531 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:39.227575 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:39.228103 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:39.228113 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:39.229750 (+ 1637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":70,"threads_started":1}
W20260620 22:04:39.229988 10464 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:39.225622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:57537 (local address 127.1.55.254:42625)
0620 22:04:39.225733 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:39.225735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:39.225766 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:04:39.225829 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:39.225830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:39.225842 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:39.225928 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:39.226263 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.226702 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.227307 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.227475 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.227522 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:39.229885 (+ 2363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:57537: BlockingRecv error: recv got EOF from 127.1.55.193:57537 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":66,"threads_started":1}
Jun 20 22:04:39 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:39 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:39.346719 10465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:39.342144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:45759)
0620 22:04:39.342280 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:39.342290 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:39.342357 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:39.342537 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:39.342538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:39.342743 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:39.342814 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:39.342817 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.343509 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.343510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:39.344041 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:39.344042 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.344396 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.344396 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:39.344450 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:39.344854 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:39.344858 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:39.346623 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
W20260620 22:04:39.346750 10464 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:39.342216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:45759 (local address 127.1.55.254:42625)
0620 22:04:39.342256 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:39.342258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:39.342347 (+ 89us) server_negotiation.cc:407] Connection header received
0620 22:04:39.342413 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:39.342414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:39.342425 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:39.342475 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:39.342881 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.343438 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.344122 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.344333 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.344397 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:39.346691 (+ 2294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:45759: BlockingRecv error: recv got EOF from 127.1.55.194:45759 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Jun 20 22:04:39 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:39 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:39.464391 10466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:39.459884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:51425)
0620 22:04:39.460035 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:39.460043 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:39.460163 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:39.460339 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:39.460340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:39.460509 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:39.460549 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:39.460550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.461205 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.461206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:39.461758 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:39.461759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.462113 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.462114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:39.462175 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:39.462608 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:39.462612 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:39.464289 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":57,"threads_started":1}
W20260620 22:04:39.464421 10464 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:39.459911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:51425 (local address 127.1.55.254:42625)
0620 22:04:39.459958 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:39.459960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:39.460149 (+ 189us) server_negotiation.cc:407] Connection header received
0620 22:04:39.460249 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:39.460249 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:39.460263 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:39.460334 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:39.460634 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.461119 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.461844 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:39.462027 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:39.462113 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:39.464358 (+ 2245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:51425: BlockingRecv error: recv got EOF from 127.1.55.195:51425 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Jun 20 22:04:40 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:40 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:40.234602 10467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:40.230330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:46963)
0620 22:04:40.230457 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:40.230468 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:40.230528 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:40.230682 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:40.230683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:40.230841 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:40.230886 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:40.230888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.231510 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.231511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:40.232024 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:40.232025 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.232324 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.232325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:40.232360 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:40.232862 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:40.232870 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:40.234536 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":77,"threads_started":1}
W20260620 22:04:40.234705 10468 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:40.230425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:46963 (local address 127.1.55.254:42625)
0620 22:04:40.230543 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:40.230544 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:40.230581 (+ 37us) server_negotiation.cc:407] Connection header received
0620 22:04:40.230601 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:40.230602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:40.230612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:40.230664 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:40.230952 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.231446 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.232097 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.232267 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.232311 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:40.234631 (+ 2320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:46963: BlockingRecv error: recv got EOF from 127.1.55.193:46963 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
Jun 20 22:04:40 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:40 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:40.351289 10469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:40.347117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:34717)
0620 22:04:40.347229 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:40.347239 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:40.347296 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:40.347406 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:40.347406 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:40.347551 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:40.347690 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:40.347692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.348304 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.348304 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:40.348891 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:40.348894 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.349193 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.349193 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:40.349228 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:40.349638 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:40.349642 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:40.351234 (+ 1592us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":70,"threads_started":1}
W20260620 22:04:40.351430 10468 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:40.347216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:34717 (local address 127.1.55.254:42625)
0620 22:04:40.347254 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:40.347256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:40.347288 (+ 32us) server_negotiation.cc:407] Connection header received
0620 22:04:40.347336 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:40.347337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:40.347344 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:40.347390 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:40.347760 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.348228 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.348970 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.349136 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.349184 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:40.351338 (+ 2154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:34717: BlockingRecv error: recv got EOF from 127.1.55.194:34717 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Jun 20 22:04:40 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:40 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:40.468973 10470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:40.464935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:57459)
0620 22:04:40.465081 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:40.465107 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:40.465158 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:40.465268 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:40.465269 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:40.465409 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:40.465451 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:40.465452 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.466061 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.466061 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:40.466557 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:40.466559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.466844 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.466845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:40.466879 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:40.467291 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:40.467295 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:40.468911 (+ 1616us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
W20260620 22:04:40.469035 10468 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:40.465000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:57459 (local address 127.1.55.254:42625)
0620 22:04:40.465075 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:40.465077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:40.465160 (+ 83us) server_negotiation.cc:407] Connection header received
0620 22:04:40.465197 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:40.465197 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:40.465207 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:40.465252 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:40.465572 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.466000 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.466627 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:40.466786 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:40.466831 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:40.468991 (+ 2160us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:57459: BlockingRecv error: recv got EOF from 127.1.55.195:57459 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Jun 20 22:04:41 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:41 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:41.239584 10471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:41.235201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:32909)
0620 22:04:41.235349 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:41.235359 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:41.235417 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:41.235557 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:41.235558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:41.235716 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:41.235762 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:41.235763 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.236376 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.236377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:41.236898 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:41.236900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.237199 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.237200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:41.237234 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:41.237760 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:41.237765 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:41.239518 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
W20260620 22:04:41.239660 10472 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:41.235252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:32909 (local address 127.1.55.254:42625)
0620 22:04:41.235408 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:41.235412 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:41.235426 (+ 14us) server_negotiation.cc:407] Connection header received
0620 22:04:41.235464 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:41.235464 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:41.235474 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:41.235535 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:41.235829 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.236310 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.236963 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.237140 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.237185 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:41.239608 (+ 2423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:32909: BlockingRecv error: recv got EOF from 127.1.55.193:32909 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":102,"threads_started":1}
Jun 20 22:04:41 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:41 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:41.355932 10473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:41.351729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:48809)
0620 22:04:41.351876 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:41.351887 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:41.351966 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:41.352099 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:41.352100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:41.352250 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:41.352289 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:41.352291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.352913 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.352914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:41.353421 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:41.353422 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.353803 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.353804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:41.353881 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:41.354303 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:41.354308 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:41.355839 (+ 1531us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":71,"threads_started":1}
W20260620 22:04:41.355973 10472 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:41.351803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:48809 (local address 127.1.55.254:42625)
0620 22:04:41.351863 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:41.351865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:41.351950 (+ 85us) server_negotiation.cc:407] Connection header received
0620 22:04:41.352016 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:41.352017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:41.352028 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:41.352093 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:41.352358 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.352827 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.353544 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.353725 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.353792 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:41.355912 (+ 2120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:48809: BlockingRecv error: recv got EOF from 127.1.55.194:48809 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Jun 20 22:04:41 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:41 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.195@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:41.473979 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:41.469529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.195:49855)
0620 22:04:41.469691 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:41.469700 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:41.469781 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:41.469911 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:41.469912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:41.470053 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:41.470108 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:41.470109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.470767 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.470768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:41.471358 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:41.471360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.471726 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.471727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:41.471762 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:41.472277 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:41.472282 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:41.473886 (+ 1604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":98,"threads_started":1}
W20260620 22:04:41.474009 10472 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:41.469567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:49855 (local address 127.1.55.254:42625)
0620 22:04:41.469621 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:41.469623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:41.469785 (+ 162us) server_negotiation.cc:407] Connection header received
0620 22:04:41.469826 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:41.469826 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:41.469838 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:41.469895 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:41.470164 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.470693 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.471426 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:41.471660 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:41.471716 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:41.473949 (+ 2233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.195:49855: BlockingRecv error: recv got EOF from 127.1.55.195:49855 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Jun 20 22:04:42 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:42 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.193@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:42.248728 10475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.240139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.193:39543)
0620 22:04:42.240281 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:42.240290 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:42.240334 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:42.240491 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:42.240491 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:42.240644 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:42.240692 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.240693 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.241551 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.241552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.242193 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.242196 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.242582 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.242583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.242649 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.246879 (+ 4230us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:42.246883 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:42.248672 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
W20260620 22:04:42.248860 10476 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:42.240209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:39543 (local address 127.1.55.254:42625)
0620 22:04:42.240309 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:42.240311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:42.240321 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:04:42.240389 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:42.240389 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:42.240399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:42.240456 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:42.240751 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.241458 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.242255 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.242437 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.242502 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.248779 (+ 6277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.193:39543: BlockingRecv error: recv got EOF from 127.1.55.193:39543 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":49,"threads_started":1}
Jun 20 22:04:42 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
Jun 20 22:04:42 dist-test-slave-xw35 krb5kdc[9418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.55.194@KRBTEST.COM for oryx/127.1.55.254@KRBTEST.COM, Server not found in Kerberos database
I20260620 22:04:42.360510 10477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.356404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:42625 (local address 127.1.55.194:44179)
0620 22:04:42.356554 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:42.356563 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:42.356621 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:42.356733 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:42.356733 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:42.356863 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:42.356905 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.356906 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.357447 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.357448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.357938 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.357939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.358233 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.358234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.358267 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.358708 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:42.358712 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:42.360441 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.55.254:42625: Server oryx/127.1.55.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
W20260620 22:04:42.360628 10476 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:42.356463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:44179 (local address 127.1.55.254:42625)
0620 22:04:42.356526 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:42.356528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:42.356622 (+ 94us) server_negotiation.cc:407] Connection header received
0620 22:04:42.356670 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:42.356671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:42.356680 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:42.356718 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:42.356961 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.357390 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.358005 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.358172 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.358222 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.360539 (+ 2317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.55.194:44179: BlockingRecv error: recv got EOF from 127.1.55.194:44179 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 22:04:42.401281 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 10001
I20260620 22:04:42.405334 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 10153
I20260620 22:04:42.409330 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 10285
I20260620 22:04:42.413380 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 9931
2026-06-20T22:04:42Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17261 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-06-20T22:04:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:04:42Z Disabled control of system clock
I20260620 22:04:42.439021 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40485
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:40485
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260620 22:04:42.510629 10481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:42.510836 10481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:42.510872 10481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:42.511996 10481 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:04:42.512054 10481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:42.512076 10481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:42.512100 10481 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:04:42.512137 10481 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:04:42.513355 10481 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:40485
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:42.513603 10481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:42.513844 10481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:42.518220 10487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:42.518229 10489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:42.518229 10486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:42.518316 10481 server_base.cc:1034] running on GCE node
I20260620 22:04:42.518666 10481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:42.518879 10481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:42.520011 10481 hybrid_clock.cc:648] HybridClock initialized: now 1781993082520001 us; error 25 us; skew 500 ppm
I20260620 22:04:42.521121 10481 webserver.cc:460] Webserver started at http://127.1.55.254:39411/ using document root <none> and password file <none>
I20260620 22:04:42.521339 10481 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:42.521385 10481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:42.521561 10481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:42.522603 10481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "05beeec42a17441a81baf98d6958628e"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "e80c276976e22357b532d25e32b94d2c"
server_key_iv: "2aa9af784e87ba076d9ce2d0cae88a20"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.522912 10481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "05beeec42a17441a81baf98d6958628e"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "e80c276976e22357b532d25e32b94d2c"
server_key_iv: "2aa9af784e87ba076d9ce2d0cae88a20"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.523998 10481 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:04:42.524616 10495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.524762 10481 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:04:42.524835 10481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "05beeec42a17441a81baf98d6958628e"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "e80c276976e22357b532d25e32b94d2c"
server_key_iv: "2aa9af784e87ba076d9ce2d0cae88a20"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.524879 10481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:42.538658 10481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:42.538864 10481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:42.538954 10481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:42.542447 10481 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:40485
I20260620 22:04:42.542492 10547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:40485 every 8 connection(s)
I20260620 22:04:42.542789 10481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:04:42.543435 10548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:42.545794 10548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e: Bootstrap starting.
I20260620 22:04:42.546288 10548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:42.546540 10548 log.cc:824] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:42.547142 10548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e: No bootstrap required, opened a new log
I20260620 22:04:42.548628 10548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beeec42a17441a81baf98d6958628e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40485 } }
I20260620 22:04:42.548794 10548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:42.548847 10548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05beeec42a17441a81baf98d6958628e, State: Initialized, Role: FOLLOWER
I20260620 22:04:42.549041 10548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beeec42a17441a81baf98d6958628e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40485 } }
I20260620 22:04:42.549136 10548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:04:42.549176 10548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:04:42.549223 10548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:42.549750 10548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beeec42a17441a81baf98d6958628e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40485 } }
I20260620 22:04:42.549857 10548 leader_election.cc:302] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05beeec42a17441a81baf98d6958628e; no voters:
I20260620 22:04:42.550014 10548 leader_election.cc:288] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:04:42.550071 10551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:42.550251 10548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:04:42.550258 10551 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [term 1 LEADER]: Becoming Leader. State: Replica: 05beeec42a17441a81baf98d6958628e, State: Running, Role: LEADER
I20260620 22:04:42.550408 10551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beeec42a17441a81baf98d6958628e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40485 } }
I20260620 22:04:42.550911 10553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05beeec42a17441a81baf98d6958628e. Latest consensus state: current_term: 1 leader_uuid: "05beeec42a17441a81baf98d6958628e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beeec42a17441a81baf98d6958628e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40485 } } }
I20260620 22:04:42.550992 10553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:42.551326 10560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:04:42.551563 10552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05beeec42a17441a81baf98d6958628e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05beeec42a17441a81baf98d6958628e" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40485 } } }
I20260620 22:04:42.551645 10552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:42.551836 10560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:04:42.552865 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 10481
I20260620 22:04:42.552958 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:04:42.553144 1247 external_mini_cluster.cc:1428] Setting key c2260d435cc8097d9f18f87418936706
I20260620 22:04:42.553375 10560 catalog_manager.cc:1347] Generated new cluster ID: 66d03d76d86b4a4fac3d1d4f1b086dc5
I20260620 22:04:42.553421 10560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:04:42.556118 10560 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:04:42.556566 10560 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:04:42.558331 10560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05beeec42a17441a81baf98d6958628e: Generated new TSK 0
I20260620 22:04:42.558465 10560 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:04:42.562088 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.553703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38178 (local address 127.1.55.254:40485)
0620 22:04:42.557626 (+ 3923us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:42.557637 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:42.557683 (+ 46us) server_negotiation.cc:407] Connection header received
0620 22:04:42.557801 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:42.557809 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:42.557871 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:42.558000 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:42.558213 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.559155 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.559934 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.560583 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.560697 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.561363 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:42.561367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:42.561367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:04:42.561606 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:42.561649 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:04:42.561659 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:42.561736 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:42.561819 (+ 83us) server_negotiation.cc:299] Negotiation successful
0620 22:04:42.561895 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3849,"thread_start_us":62,"threads_started":1}
I20260620 22:04:42.563340 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40485
--builtin_ntp_servers=127.1.55.212:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260620 22:04:42.636078 10572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:42.636274 10572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:42.636305 10572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:42.637317 10572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:42.637375 10572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:42.637413 10572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:04:42.638664 10572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:42.638931 10572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:42.639204 10572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:42.644623 10578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:42.644603 10580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:42.644790 10572 server_base.cc:1034] running on GCE node
W20260620 22:04:42.644616 10577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:42.645051 10572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:42.645303 10572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:42.646476 10572 hybrid_clock.cc:648] HybridClock initialized: now 1781993082646436 us; error 55 us; skew 500 ppm
I20260620 22:04:42.647921 10572 webserver.cc:460] Webserver started at http://127.1.55.193:33999/ using document root <none> and password file <none>
I20260620 22:04:42.648171 10572 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:42.648214 10572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:42.648332 10572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:42.649313 10572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "796ae68c655c4976ada388689796ba26"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "041989c984523c384d053f87a8c1833d"
server_key_iv: "d43c9ff551e624a527dd14ea8755d19a"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.649660 10572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "796ae68c655c4976ada388689796ba26"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "041989c984523c384d053f87a8c1833d"
server_key_iv: "d43c9ff551e624a527dd14ea8755d19a"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.650993 10572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:04:42.651733 10586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.651895 10572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:04:42.651968 10572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "796ae68c655c4976ada388689796ba26"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "041989c984523c384d053f87a8c1833d"
server_key_iv: "d43c9ff551e624a527dd14ea8755d19a"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.652026 10572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:42.672251 10572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:42.672547 10572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:42.672698 10572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:42.672878 10572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:42.673157 10572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:42.673207 10572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.673245 10572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:42.673270 10572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.678777 10572 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:45303
I20260620 22:04:42.678864 10699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:45303 every 8 connection(s)
I20260620 22:04:42.679208 10572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:04:42.683638 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.679857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:43883 (local address 127.1.55.254:40485)
0620 22:04:42.679928 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:42.679930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:42.680115 (+ 185us) server_negotiation.cc:407] Connection header received
0620 22:04:42.680550 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:42.680551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:42.680582 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:42.680634 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:42.681195 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.681759 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.682635 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.682801 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.682847 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.683462 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:42.683463 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:42.683463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:04:42.683467 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:42.683478 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:04:42.683481 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:42.683516 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:42.683567 (+ 51us) server_negotiation.cc:299] Negotiation successful
0620 22:04:42.683589 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 22:04:42.683787 10702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.679832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40485 (local address 127.1.55.193:43883)
0620 22:04:42.680007 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:42.680037 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:42.680471 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:42.680681 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:42.680684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:42.680692 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:42.681131 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.681134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.681831 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.681831 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.682570 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.682571 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.682864 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.682865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.682954 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.683359 (+ 405us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:04:42.683359 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:42.683381 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:04:42.683399 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:42.683517 (+ 118us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:42.683519 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:42.683520 (+ 1us) client_negotiation.cc:769] Sending connection context
0620 22:04:42.683558 (+ 38us) client_negotiation.cc:240] Negotiation successful
0620 22:04:42.683626 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
I20260620 22:04:42.684298 10700 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40485
I20260620 22:04:42.684386 10700 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:42.684542 10700 heartbeater.cc:511] Master 127.1.55.254:40485 requested a full tablet report, sending...
I20260620 22:04:42.684985 10512 ts_manager.cc:194] Registered new tserver with Master: 796ae68c655c4976ada388689796ba26 (127.1.55.193:45303)
I20260620 22:04:42.685580 10512 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.193:43883
I20260620 22:04:42.687935 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 10572
I20260620 22:04:42.688009 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:04:42.688148 1247 external_mini_cluster.cc:1428] Setting key 2e33a3e3ae781612672f15ad82eba917
I20260620 22:04:42.688964 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40485
--builtin_ntp_servers=127.1.55.212:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260620 22:04:42.761911 10703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:42.762079 10703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:42.762099 10703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:42.763128 10703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:42.763170 10703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:42.763191 10703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:04:42.764365 10703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:42.764575 10703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:42.764829 10703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:42.769301 10711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:42.769310 10708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:42.769371 10703 server_base.cc:1034] running on GCE node
W20260620 22:04:42.769315 10709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:42.769749 10703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:42.769929 10703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:42.771060 10703 hybrid_clock.cc:648] HybridClock initialized: now 1781993082771052 us; error 24 us; skew 500 ppm
I20260620 22:04:42.772174 10703 webserver.cc:460] Webserver started at http://127.1.55.194:43367/ using document root <none> and password file <none>
I20260620 22:04:42.772370 10703 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:42.772409 10703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:42.772548 10703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:42.773438 10703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "3b73f64b38ce402b899afab647ba03b4"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "b8f9b8308c2d4a79cf611b0bf3112500"
server_key_iv: "56b138e0e5ba3d4e1ad2414d6df2c57b"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.773806 10703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "3b73f64b38ce402b899afab647ba03b4"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "b8f9b8308c2d4a79cf611b0bf3112500"
server_key_iv: "56b138e0e5ba3d4e1ad2414d6df2c57b"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.774899 10703 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:04:42.775470 10717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.775620 10703 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:42.775677 10703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "3b73f64b38ce402b899afab647ba03b4"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "b8f9b8308c2d4a79cf611b0bf3112500"
server_key_iv: "56b138e0e5ba3d4e1ad2414d6df2c57b"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.775764 10703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:42.806334 10703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:42.806561 10703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:42.806684 10703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:42.806885 10703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:42.807193 10703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:42.807235 10703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.807260 10703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:42.807282 10703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.813666 10703 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:44175
I20260620 22:04:42.813706 10830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:44175 every 8 connection(s)
I20260620 22:04:42.813966 10703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:04:42.818037 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.814557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:60657 (local address 127.1.55.254:40485)
0620 22:04:42.814596 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:42.814598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:42.814797 (+ 199us) server_negotiation.cc:407] Connection header received
0620 22:04:42.815186 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:42.815187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:42.815195 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:42.815243 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:42.815777 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.816207 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.817008 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.817159 (+ 151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.817200 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.817848 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:42.817850 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:42.817850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:04:42.817854 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:42.817866 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:04:42.817869 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:42.817910 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:42.817964 (+ 54us) server_negotiation.cc:299] Negotiation successful
0620 22:04:42.817986 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:04:42.818169 10833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.814525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40485 (local address 127.1.55.194:60657)
0620 22:04:42.814688 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:42.814721 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:42.815116 (+ 395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:42.815286 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:42.815288 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:42.815295 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:42.815701 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.815704 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.816275 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.816276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.816946 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.816947 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.817219 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.817219 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.817306 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.817738 (+ 432us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:04:42.817739 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:42.817761 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:04:42.817778 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:42.817912 (+ 134us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:42.817914 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:42.817916 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:04:42.817954 (+ 38us) client_negotiation.cc:240] Negotiation successful
0620 22:04:42.818013 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":86,"threads_started":1}
I20260620 22:04:42.818581 10831 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40485
I20260620 22:04:42.818665 10831 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:42.818806 10831 heartbeater.cc:511] Master 127.1.55.254:40485 requested a full tablet report, sending...
I20260620 22:04:42.819126 10512 ts_manager.cc:194] Registered new tserver with Master: 3b73f64b38ce402b899afab647ba03b4 (127.1.55.194:44175)
I20260620 22:04:42.819427 10512 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.194:60657
I20260620 22:04:42.823205 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 10703
I20260620 22:04:42.823278 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:04:42.823463 1247 external_mini_cluster.cc:1428] Setting key 92d3921aa6076053e54b3121d93b0f2a
I20260620 22:04:42.824285 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40485
--builtin_ntp_servers=127.1.55.212:46831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260620 22:04:42.897907 10834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:42.898064 10834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:42.898082 10834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:42.899049 10834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:42.899078 10834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:42.899101 10834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:04:42.900182 10834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40485
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:42.900326 10834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:42.900564 10834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:42.904910 10840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:42.904891 10842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:42.904958 10834 server_base.cc:1034] running on GCE node
W20260620 22:04:42.904896 10839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:42.905253 10834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:42.905423 10834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:42.906572 10834 hybrid_clock.cc:648] HybridClock initialized: now 1781993082906541 us; error 32 us; skew 500 ppm
I20260620 22:04:42.907835 10834 webserver.cc:460] Webserver started at http://127.1.55.195:35893/ using document root <none> and password file <none>
I20260620 22:04:42.908018 10834 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:42.908057 10834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:42.908141 10834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:42.909039 10834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "8494dcd2314e4fc39a05b45bf927e5f5"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "f6945231cd46033af8b4d4b6b73a6dcb"
server_key_iv: "8dcf044648af105eceeaeb3b6aa7fb70"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.909300 10834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "8494dcd2314e4fc39a05b45bf927e5f5"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "f6945231cd46033af8b4d4b6b73a6dcb"
server_key_iv: "8dcf044648af105eceeaeb3b6aa7fb70"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.910493 10834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:04:42.911164 10848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.911310 10834 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:42.911388 10834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "8494dcd2314e4fc39a05b45bf927e5f5"
format_stamp: "Formatted at 2026-06-20 22:04:42 on dist-test-slave-xw35"
server_key: "f6945231cd46033af8b4d4b6b73a6dcb"
server_key_iv: "8dcf044648af105eceeaeb3b6aa7fb70"
server_key_version: "encryptionkey@0"
I20260620 22:04:42.911439 10834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:42.931679 10834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:42.931882 10834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:42.931967 10834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:42.932118 10834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:42.932327 10834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:42.932354 10834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.932372 10834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:42.932384 10834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:42.937373 10834 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:43587
I20260620 22:04:42.937440 10961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:43587 every 8 connection(s)
I20260620 22:04:42.937716 10834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:04:42.938195 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 10834
I20260620 22:04:42.938300 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:04:42.938488 1247 external_mini_cluster.cc:1428] Setting key dcbe781be76c2910d29efe9c9d1047e1
I20260620 22:04:42.942550 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.938661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:40275 (local address 127.1.55.254:40485)
0620 22:04:42.938731 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:42.938733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:42.938743 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:04:42.939217 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:42.939218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:42.939228 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:42.939270 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:42.939871 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.940326 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.941279 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.941508 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.941583 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.942332 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:42.942333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:42.942333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:04:42.942337 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:42.942350 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:04:42.942354 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:42.942394 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:42.942458 (+ 64us) server_negotiation.cc:299] Negotiation successful
0620 22:04:42.942484 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260620 22:04:42.942739 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:42.938345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40485 (local address 127.1.55.195:40275)
0620 22:04:42.938540 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:42.938580 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:42.939102 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:42.939331 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:42.939335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:42.939344 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:42.939787 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.939791 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.940412 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.940413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.941179 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:42.941180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:42.941590 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:42.941591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:42.941727 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:42.942200 (+ 473us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:04:42.942200 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:42.942223 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:04:42.942240 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:42.942394 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:42.942398 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:42.942401 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:04:42.942460 (+ 59us) client_negotiation.cc:240] Negotiation successful
0620 22:04:42.942539 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260620 22:04:42.943109 10962 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40485
I20260620 22:04:42.943172 10962 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:42.943331 10962 heartbeater.cc:511] Master 127.1.55.254:40485 requested a full tablet report, sending...
I20260620 22:04:42.943624 10512 ts_manager.cc:194] Registered new tserver with Master: 8494dcd2314e4fc39a05b45bf927e5f5 (127.1.55.195:43587)
I20260620 22:04:42.943940 10512 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.195:40275
I20260620 22:04:42.950183 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260620 22:04:42.951862 10571 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:42.951433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38188 (local address 127.1.55.254:40485)
0620 22:04:42.951468 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:42.951469 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:42.951574 (+ 105us) server_negotiation.cc:407] Connection header received
0620 22:04:42.951624 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:42.951624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:42.951632 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:42.951694 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:42.951795 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38188: BlockingRecv error: recv got EOF from 127.0.0.1:38188 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:04:42.951968 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 10572
I20260620 22:04:42.956127 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 10703
I20260620 22:04:42.959967 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 10834
I20260620 22:04:42.963711 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 10481
2026-06-20T22:04:42Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (549 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-06-20T22:04:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:04:42Z Disabled control of system clock
I20260620 22:04:42.988727 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:37559
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:39571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:37559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260620 22:04:43.061965 10973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:43.062124 10973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:43.062165 10973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:43.063809 10973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:04:43.063870 10973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:43.063892 10973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:43.063920 10973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:04:43.063937 10973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:04:43.065179 10973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:39571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:37559
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:37559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:43.065407 10973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:43.065685 10973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:43.069953 10981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:43.070005 10978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:43.070011 10979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:43.070108 10973 server_base.cc:1034] running on GCE node
I20260620 22:04:43.070372 10973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:43.070588 10973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:43.071734 10973 hybrid_clock.cc:648] HybridClock initialized: now 1781993083071713 us; error 37 us; skew 500 ppm
I20260620 22:04:43.072935 10973 webserver.cc:460] Webserver started at http://127.1.55.254:46167/ using document root <none> and password file <none>
I20260620 22:04:43.073140 10973 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:43.073182 10973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:43.073311 10973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:43.074249 10973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "d4a97361014242a3acd426a7b69723ab"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "613bbfce2f8e9cb1bd432e5798c8d4b3"
server_key_iv: "413443d9e04555ce515ca030ba4d26f3"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.074560 10973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "d4a97361014242a3acd426a7b69723ab"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "613bbfce2f8e9cb1bd432e5798c8d4b3"
server_key_iv: "413443d9e04555ce515ca030ba4d26f3"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.075784 10973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:04:43.076395 10987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.076552 10973 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:43.076650 10973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "d4a97361014242a3acd426a7b69723ab"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "613bbfce2f8e9cb1bd432e5798c8d4b3"
server_key_iv: "413443d9e04555ce515ca030ba4d26f3"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.076720 10973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:43.079710 10973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:43.079948 10973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:43.080090 10973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:43.084051 10973 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:37559
I20260620 22:04:43.084079 11039 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:37559 every 8 connection(s)
I20260620 22:04:43.084371 10973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:04:43.084923 11040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:43.087230 11040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab: Bootstrap starting.
I20260620 22:04:43.087706 11040 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:43.087929 11040 log.cc:824] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:43.088475 11040 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab: No bootstrap required, opened a new log
I20260620 22:04:43.089895 11040 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a97361014242a3acd426a7b69723ab" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 37559 } }
I20260620 22:04:43.090003 11040 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:43.090023 11040 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4a97361014242a3acd426a7b69723ab, State: Initialized, Role: FOLLOWER
I20260620 22:04:43.090139 11040 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a97361014242a3acd426a7b69723ab" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 37559 } }
I20260620 22:04:43.090209 11040 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:04:43.090229 11040 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:04:43.090252 11040 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:43.090696 11040 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a97361014242a3acd426a7b69723ab" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 37559 } }
I20260620 22:04:43.090773 11040 leader_election.cc:302] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4a97361014242a3acd426a7b69723ab; no voters:
I20260620 22:04:43.090879 11040 leader_election.cc:288] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:04:43.090955 11043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:43.091109 11040 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:04:43.091127 11043 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [term 1 LEADER]: Becoming Leader. State: Replica: d4a97361014242a3acd426a7b69723ab, State: Running, Role: LEADER
I20260620 22:04:43.091243 11043 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a97361014242a3acd426a7b69723ab" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 37559 } }
I20260620 22:04:43.091848 11044 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4a97361014242a3acd426a7b69723ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a97361014242a3acd426a7b69723ab" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 37559 } } }
I20260620 22:04:43.092025 11044 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:43.092276 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 10973
I20260620 22:04:43.092283 11056 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:04:43.092361 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:04:43.092538 1247 external_mini_cluster.cc:1428] Setting key 4b1195e405a4b69b9769047db2e2fe99
I20260620 22:04:43.092823 11056 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:04:43.092826 11045 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4a97361014242a3acd426a7b69723ab. Latest consensus state: current_term: 1 leader_uuid: "d4a97361014242a3acd426a7b69723ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4a97361014242a3acd426a7b69723ab" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 37559 } } }
I20260620 22:04:43.092979 11045 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:43.094516 11056 catalog_manager.cc:1347] Generated new cluster ID: 91ac66dd9b0f4d208e4bbe6eb3207ce0
I20260620 22:04:43.094579 11056 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:04:43.094702 11062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:43.093092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.1.55.254:37559)
0620 22:04:43.093290 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:43.093297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:43.093325 (+ 28us) server_negotiation.cc:407] Connection header received
0620 22:04:43.093417 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:43.093424 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:43.093461 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:43.093604 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:43.094208 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:43.094211 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:43.094211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:04:43.094214 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:43.094249 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:04:43.094262 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:43.094317 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:43.094412 (+ 95us) server_negotiation.cc:299] Negotiation successful
0620 22:04:43.094461 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":65,"threads_started":1}
I20260620 22:04:43.100594 11056 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:04:43.100708 11056 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:04:43.105413 11056 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4a97361014242a3acd426a7b69723ab: Generated new TSK 0
I20260620 22:04:43.105597 11056 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:04:43.109315 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:37559
--builtin_ntp_servers=127.1.55.212:39571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260620 22:04:43.183983 11064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:43.184141 11064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:43.184159 11064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:43.185256 11064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:43.185292 11064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:43.185316 11064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:04:43.186626 11064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:39571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:37559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:43.186831 11064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:43.187100 11064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:43.192371 11069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:43.192385 11070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:43.192562 11072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:43.192775 11064 server_base.cc:1034] running on GCE node
I20260620 22:04:43.192986 11064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:43.193214 11064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:43.194355 11064 hybrid_clock.cc:648] HybridClock initialized: now 1781993083194340 us; error 31 us; skew 500 ppm
I20260620 22:04:43.195622 11064 webserver.cc:460] Webserver started at http://127.1.55.193:41061/ using document root <none> and password file <none>
I20260620 22:04:43.195860 11064 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:43.195899 11064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:43.196014 11064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:43.196928 11064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "2c7178ddcc3e4cbebf671071e4034e85"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "44e382dcbd61b8bad4751810c12f50b4"
server_key_iv: "b870fbb8beacf2b5340f5cfde89fc640"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.197237 11064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "2c7178ddcc3e4cbebf671071e4034e85"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "44e382dcbd61b8bad4751810c12f50b4"
server_key_iv: "b870fbb8beacf2b5340f5cfde89fc640"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.198503 11064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:04:43.199194 11078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.199342 11064 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:43.199440 11064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "2c7178ddcc3e4cbebf671071e4034e85"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "44e382dcbd61b8bad4751810c12f50b4"
server_key_iv: "b870fbb8beacf2b5340f5cfde89fc640"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.199499 11064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:43.203527 11064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:43.203737 11064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:43.203845 11064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:43.204046 11064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:43.204356 11064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:43.204402 11064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.204440 11064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:43.204466 11064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.210242 11064 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:45985
I20260620 22:04:43.210309 11191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:45985 every 8 connection(s)
I20260620 22:04:43.210584 11064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:04:43.213120 11062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:43.211234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:60163 (local address 127.1.55.254:37559)
0620 22:04:43.211276 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:43.211278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:43.211502 (+ 224us) server_negotiation.cc:407] Connection header received
0620 22:04:43.211881 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:43.211882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:43.211887 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:43.211940 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:43.212952 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:43.212953 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:43.212953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:04:43.212955 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:43.212964 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:04:43.212967 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:43.213018 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:43.213061 (+ 43us) server_negotiation.cc:299] Negotiation successful
0620 22:04:43.213071 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:04:43.213321 11194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:43.211198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:37559 (local address 127.1.55.193:60163)
0620 22:04:43.211373 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:43.211411 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:43.211809 (+ 398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:43.211984 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:43.211987 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:43.211993 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:43.212828 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:04:43.212828 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:43.212851 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:04:43.212875 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:43.213018 (+ 143us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:43.213020 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:43.213023 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:04:43.213068 (+ 45us) client_negotiation.cc:240] Negotiation successful
0620 22:04:43.213107 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
I20260620 22:04:43.213398 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 11064
I20260620 22:04:43.213501 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:04:43.213657 1247 external_mini_cluster.cc:1428] Setting key 6ec9a8f6974b9290fe5f323aeb057a9e
I20260620 22:04:43.214088 11192 heartbeater.cc:347] Connected to a master server at 127.1.55.254:37559
I20260620 22:04:43.214195 11192 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:43.214314 11192 heartbeater.cc:511] Master 127.1.55.254:37559 requested a full tablet report, sending...
I20260620 22:04:43.214552 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:37559
--builtin_ntp_servers=127.1.55.212:39571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260620 22:04:43.214763 11004 ts_manager.cc:194] Registered new tserver with Master: 2c7178ddcc3e4cbebf671071e4034e85 (127.1.55.193:45985)
W20260620 22:04:43.286993 11195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:43.287143 11195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:43.287163 11195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:43.288203 11195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:43.288236 11195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:43.288260 11195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:04:43.289456 11195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:39571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:37559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:43.289652 11195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:43.289862 11195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:43.294482 11200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:43.294471 11203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:43.294469 11201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:43.294665 11195 server_base.cc:1034] running on GCE node
I20260620 22:04:43.294858 11195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:43.295070 11195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:43.296221 11195 hybrid_clock.cc:648] HybridClock initialized: now 1781993083296213 us; error 38 us; skew 500 ppm
I20260620 22:04:43.297423 11195 webserver.cc:460] Webserver started at http://127.1.55.194:37811/ using document root <none> and password file <none>
I20260620 22:04:43.297680 11195 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:43.297760 11195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:43.297885 11195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:43.298803 11195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "522fd4e52e62453a9cb4a3c4e3e91fe8"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "dfe423308ac769d1c13451409b71fe14"
server_key_iv: "493775d8b595653b04781aefef7adf24"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.299114 11195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "522fd4e52e62453a9cb4a3c4e3e91fe8"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "dfe423308ac769d1c13451409b71fe14"
server_key_iv: "493775d8b595653b04781aefef7adf24"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.300300 11195 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:04:43.300980 11209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.301155 11195 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:43.301249 11195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "522fd4e52e62453a9cb4a3c4e3e91fe8"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "dfe423308ac769d1c13451409b71fe14"
server_key_iv: "493775d8b595653b04781aefef7adf24"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.301332 11195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:43.304960 11195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:43.305181 11195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:43.305305 11195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:43.305524 11195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:43.305784 11195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:43.305831 11195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.305866 11195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:43.305889 11195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.311543 11195 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:37201
I20260620 22:04:43.311585 11322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:37201 every 8 connection(s)
I20260620 22:04:43.311877 11195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:04:43.314213 11062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:43.312431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:45179 (local address 127.1.55.254:37559)
0620 22:04:43.312489 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:43.312491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:43.312661 (+ 170us) server_negotiation.cc:407] Connection header received
0620 22:04:43.312998 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:43.312999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:43.313003 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:43.313051 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:43.314032 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:43.314033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:43.314033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:04:43.314037 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:43.314051 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:04:43.314055 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:43.314103 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:43.314152 (+ 49us) server_negotiation.cc:299] Negotiation successful
0620 22:04:43.314163 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 22:04:43.314391 11325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:43.312410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:37559 (local address 127.1.55.194:45179)
0620 22:04:43.312566 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:43.312598 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:43.312931 (+ 333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:43.313089 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:43.313092 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:43.313098 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:43.313908 (+ 810us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:04:43.313908 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:43.313932 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:04:43.313954 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:43.314099 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:43.314109 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:43.314111 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:04:43.314157 (+ 46us) client_negotiation.cc:240] Negotiation successful
0620 22:04:43.314196 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260620 22:04:43.314862 11323 heartbeater.cc:347] Connected to a master server at 127.1.55.254:37559
I20260620 22:04:43.314947 11323 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:43.315079 11323 heartbeater.cc:511] Master 127.1.55.254:37559 requested a full tablet report, sending...
I20260620 22:04:43.315387 11004 ts_manager.cc:194] Registered new tserver with Master: 522fd4e52e62453a9cb4a3c4e3e91fe8 (127.1.55.194:37201)
I20260620 22:04:43.318544 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 11195
I20260620 22:04:43.318650 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:04:43.318813 1247 external_mini_cluster.cc:1428] Setting key f5ce091aa0ed43fbeb1e7b6ab15bd43e
I20260620 22:04:43.319537 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:37559
--builtin_ntp_servers=127.1.55.212:39571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260620 22:04:43.394371 11326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:43.394531 11326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:43.394550 11326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:43.395596 11326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:43.395637 11326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:43.395660 11326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:04:43.396858 11326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:39571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:37559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:43.397073 11326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:43.397326 11326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:43.401755 11332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:43.401765 11334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:43.401768 11331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:43.401975 11326 server_base.cc:1034] running on GCE node
I20260620 22:04:43.402149 11326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:43.402348 11326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:43.403486 11326 hybrid_clock.cc:648] HybridClock initialized: now 1781993083403474 us; error 30 us; skew 500 ppm
I20260620 22:04:43.404526 11326 webserver.cc:460] Webserver started at http://127.1.55.195:33317/ using document root <none> and password file <none>
I20260620 22:04:43.404690 11326 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:43.404724 11326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:43.404800 11326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:43.405802 11326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "cd829d38112d40caace752e98160a998"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "6d1fb844233f2eda39c141d50ff4ce5b"
server_key_iv: "b9594c119fc8de9dd230138725c6b7b7"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.406126 11326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "cd829d38112d40caace752e98160a998"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "6d1fb844233f2eda39c141d50ff4ce5b"
server_key_iv: "b9594c119fc8de9dd230138725c6b7b7"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.407220 11326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:04:43.407867 11340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.408030 11326 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:43.408106 11326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "cd829d38112d40caace752e98160a998"
format_stamp: "Formatted at 2026-06-20 22:04:43 on dist-test-slave-xw35"
server_key: "6d1fb844233f2eda39c141d50ff4ce5b"
server_key_iv: "b9594c119fc8de9dd230138725c6b7b7"
server_key_version: "encryptionkey@0"
I20260620 22:04:43.408156 11326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:43.411187 11326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:43.411370 11326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:43.411460 11326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:43.411603 11326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:43.411847 11326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:43.411877 11326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.411895 11326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:43.411906 11326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:43.416661 11326 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:43929
I20260620 22:04:43.416723 11453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:43929 every 8 connection(s)
I20260620 22:04:43.416891 11326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:04:43.422724 11062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:43.417430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:42129 (local address 127.1.55.254:37559)
0620 22:04:43.417521 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:43.417523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:43.417689 (+ 166us) server_negotiation.cc:407] Connection header received
0620 22:04:43.418011 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:43.418012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:43.418016 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:43.418063 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:43.422517 (+ 4454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:43.422518 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:43.422518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:04:43.422522 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:43.422535 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:04:43.422539 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:43.422588 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:43.422666 (+ 78us) server_negotiation.cc:299] Negotiation successful
0620 22:04:43.422677 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:04:43.422879 11456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:43.417398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:37559 (local address 127.1.55.195:42129)
0620 22:04:43.417574 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:43.417613 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:43.417940 (+ 327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:43.418102 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:43.418105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:43.418112 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:43.422396 (+ 4284us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:04:43.422396 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:43.422418 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:04:43.422440 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:43.422596 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:43.422600 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:43.422608 (+ 8us) client_negotiation.cc:769] Sending connection context
0620 22:04:43.422659 (+ 51us) client_negotiation.cc:240] Negotiation successful
0620 22:04:43.422698 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":103,"threads_started":1}
I20260620 22:04:43.423339 11454 heartbeater.cc:347] Connected to a master server at 127.1.55.254:37559
I20260620 22:04:43.423422 11454 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:43.423542 11454 heartbeater.cc:511] Master 127.1.55.254:37559 requested a full tablet report, sending...
I20260620 22:04:43.423769 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 11326
I20260620 22:04:43.423839 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:04:43.423870 11004 ts_manager.cc:194] Registered new tserver with Master: cd829d38112d40caace752e98160a998 (127.1.55.195:43929)
I20260620 22:04:43.423965 1247 external_mini_cluster.cc:1428] Setting key 4735926e091504f013eb6bff25dee471
I20260620 22:04:43.424758 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260620 22:04:43.426415 11062 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:04:43.425951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38094 (local address 127.1.55.254:37559)
0620 22:04:43.426019 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:43.426021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:43.426121 (+ 100us) server_negotiation.cc:407] Connection header received
0620 22:04:43.426190 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:43.426191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:43.426195 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:43.426244 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:43.426362 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38094: BlockingRecv error: recv got EOF from 127.0.0.1:38094 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 22:04:43.426512 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 11064
I20260620 22:04:43.431532 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 11195
I20260620 22:04:43.435535 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 11326
I20260620 22:04:43.439128 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 10973
2026-06-20T22:04:43Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (474 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:04:43 dist-test-slave-xw35 krb5kdc[11464](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:04:43 dist-test-slave-xw35 krb5kdc[11464](info): set up 2 sockets
Jun 20 22:04:43 dist-test-slave-xw35 krb5kdc[11464](info): commencing operation
krb5kdc: starting...
W20260620 22:04:44.429425 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.972s user 0.000s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:04:44 dist-test-slave-xw35 krb5kdc[11464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:04:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:04:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:04:44.534124 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:41213
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:41213
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:44.609491 11477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:44.609666 11477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:44.609687 11477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:44.610797 11477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:04:44.610836 11477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:44.610850 11477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:44.610863 11477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:04:44.610875 11477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:04:44.612304 11477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:41213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:41213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:44.612535 11477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:44.612775 11477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:44.617102 11482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:44.617107 11483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:44.617107 11485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:44.617122 11477 server_base.cc:1034] running on GCE node
I20260620 22:04:44.617520 11477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:44.617795 11477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:44.618947 11477 hybrid_clock.cc:648] HybridClock initialized: now 1781993084618939 us; error 26 us; skew 500 ppm
Jun 20 22:04:44 dist-test-slave-xw35 krb5kdc[11464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993084, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:44.621194 11477 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:04:44.621683 11477 webserver.cc:460] Webserver started at http://127.1.55.254:44821/ using document root <none> and password file <none>
I20260620 22:04:44.621892 11477 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:44.621964 11477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:44.622100 11477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:44.623019 11477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "b34fdbd1115a43ee9312fa60dbe30aeb"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "dd81ea71f3c590f108dae31d2751cd7a"
server_key_iv: "d31df97d161433eaf4ada2de072ecd80"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.623353 11477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "b34fdbd1115a43ee9312fa60dbe30aeb"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "dd81ea71f3c590f108dae31d2751cd7a"
server_key_iv: "d31df97d161433eaf4ada2de072ecd80"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.624531 11477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:04:44.625212 11492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:44.625370 11477 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:44.625463 11477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "b34fdbd1115a43ee9312fa60dbe30aeb"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "dd81ea71f3c590f108dae31d2751cd7a"
server_key_iv: "d31df97d161433eaf4ada2de072ecd80"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.625572 11477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:44.645586 11477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:44.647811 11477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:44.647970 11477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:44.652172 11477 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:41213
I20260620 22:04:44.652200 11544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:41213 every 8 connection(s)
I20260620 22:04:44.652534 11477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:04:44.653431 11545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:44.656081 11545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb: Bootstrap starting.
I20260620 22:04:44.656582 11545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:44.656816 11545 log.cc:824] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:44.657487 11545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb: No bootstrap required, opened a new log
I20260620 22:04:44.657905 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 11477
I20260620 22:04:44.657989 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:04:44.658179 1247 external_mini_cluster.cc:1428] Setting key f7abc05bd9efbadb22f0c9370d7be750
I20260620 22:04:44.660234 11545 raft_consensus.cc:348] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b34fdbd1115a43ee9312fa60dbe30aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41213 } }
I20260620 22:04:44.660395 11545 raft_consensus.cc:374] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:44.660427 11545 raft_consensus.cc:729] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b34fdbd1115a43ee9312fa60dbe30aeb, State: Initialized, Role: FOLLOWER
I20260620 22:04:44.660537 11545 consensus_queue.cc:260] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b34fdbd1115a43ee9312fa60dbe30aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41213 } }
I20260620 22:04:44.660640 11545 raft_consensus.cc:388] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:04:44.660671 11545 raft_consensus.cc:482] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:04:44.660713 11545 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:44.661340 11545 raft_consensus.cc:504] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b34fdbd1115a43ee9312fa60dbe30aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41213 } }
I20260620 22:04:44.661438 11545 leader_election.cc:302] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b34fdbd1115a43ee9312fa60dbe30aeb; no voters:
I20260620 22:04:44.661636 11545 leader_election.cc:288] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:04:44.661681 11550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:44.661813 11550 raft_consensus.cc:686] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [term 1 LEADER]: Becoming Leader. State: Replica: b34fdbd1115a43ee9312fa60dbe30aeb, State: Running, Role: LEADER
I20260620 22:04:44.661876 11545 sys_catalog.cc:564] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:04:44.661921 11550 consensus_queue.cc:237] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b34fdbd1115a43ee9312fa60dbe30aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41213 } }
I20260620 22:04:44.662331 11551 sys_catalog.cc:455] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b34fdbd1115a43ee9312fa60dbe30aeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b34fdbd1115a43ee9312fa60dbe30aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41213 } } }
I20260620 22:04:44.662431 11551 sys_catalog.cc:458] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:44.662616 11552 sys_catalog.cc:455] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b34fdbd1115a43ee9312fa60dbe30aeb. Latest consensus state: current_term: 1 leader_uuid: "b34fdbd1115a43ee9312fa60dbe30aeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b34fdbd1115a43ee9312fa60dbe30aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41213 } } }
I20260620 22:04:44.662707 11552 sys_catalog.cc:458] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb [sys.catalog]: This master's current role is: LEADER
I20260620 22:04:44.662844 11559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:04:44.663338 11559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:04:44.664814 11559 catalog_manager.cc:1347] Generated new cluster ID: 454903fd069940a9bb25981ab50ef730
I20260620 22:04:44.664867 11559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:04:44 dist-test-slave-xw35 krb5kdc[11464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:04:44.669647 11549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:44.658634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54470 (local address 127.1.55.254:41213)
0620 22:04:44.658820 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:44.658829 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:44.658860 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:04:44.659358 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:44.659366 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:44.659426 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:44.659578 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:44.660150 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.661512 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.662683 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.663295 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.663395 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:44.666181 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:44.666184 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:44.666185 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:44.666196 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:44.668123 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:44.668498 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:44.668501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:44.668501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:44.668603 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:44.668811 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:44.668812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:44.668812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:44.669104 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:44.669253 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:44.669339 (+ 86us) server_negotiation.cc:299] Negotiation successful
0620 22:04:44.669458 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":88,"threads_started":1}
I20260620 22:04:44.671217 11559 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:04:44.671734 11559 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:04:44.676605 11559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb: Generated new TSK 0
I20260620 22:04:44.676738 11559 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:04:44.705631 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:41213
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:44.778908 11571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:44.779099 11571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:44.779130 11571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:44.780211 11571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:44.780273 11571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:44.780315 11571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:04:44.781746 11571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:41213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:44.782009 11571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:44.782222 11571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:44.786547 11576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:44.786562 11577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:44.786609 11579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:44.786698 11571 server_base.cc:1034] running on GCE node
I20260620 22:04:44.786854 11571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:44.787070 11571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:44.788220 11571 hybrid_clock.cc:648] HybridClock initialized: now 1781993084788201 us; error 30 us; skew 500 ppm
Jun 20 22:04:44 dist-test-slave-xw35 krb5kdc[11464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993084, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:44.790588 11571 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:04:44.791040 11571 webserver.cc:460] Webserver started at http://127.1.55.193:43659/ using document root <none> and password file <none>
I20260620 22:04:44.791219 11571 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:44.791258 11571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:44.791338 11571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:44.792263 11571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "3662a2e705e64982bcfaad9da466fa05"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "6961c586ecf6c38c89984cca7c78f189"
server_key_iv: "de8f5dfbae9d73be254a5e861a0ce181"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.792524 11571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "3662a2e705e64982bcfaad9da466fa05"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "6961c586ecf6c38c89984cca7c78f189"
server_key_iv: "de8f5dfbae9d73be254a5e861a0ce181"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.794203 11571 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 22:04:44.794843 11586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:44.795013 11571 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:44.795097 11571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "3662a2e705e64982bcfaad9da466fa05"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "6961c586ecf6c38c89984cca7c78f189"
server_key_iv: "de8f5dfbae9d73be254a5e861a0ce181"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.795147 11571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:44.826738 11571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:44.828512 11571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:44.828617 11571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:44.828866 11571 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:44.829162 11571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:44.829195 11571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:44.829216 11571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:44.829262 11571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:44.834693 11571 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:46475
I20260620 22:04:44.834750 11699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:46475 every 8 connection(s)
I20260620 22:04:44.835024 11571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:04:44.839741 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 11571
I20260620 22:04:44.839824 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:04:44.840032 1247 external_mini_cluster.cc:1428] Setting key 434befacc6dce9a6a3b266e05652dba3
Jun 20 22:04:44 dist-test-slave-xw35 krb5kdc[11464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993084, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:04:44.843971 11702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:44.835675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:41213 (local address 127.1.55.193:59219)
0620 22:04:44.835832 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:44.835864 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:44.836288 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:44.836472 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:44.836475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:44.836970 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:44.837147 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:44.837152 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.837782 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.837783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:44.838529 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:44.838532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.838843 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.838844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:44.838933 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:44.839330 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:44.839337 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:44.840861 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:44.842672 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:44.842678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:44.842680 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:44.842964 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:44.843149 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:44.843150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:44.843151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:44.843282 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:44.843507 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:44.843512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:44.843639 (+ 127us) client_negotiation.cc:769] Sending connection context
0620 22:04:44.843728 (+ 89us) client_negotiation.cc:240] Negotiation successful
0620 22:04:44.843830 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
I20260620 22:04:44.844003 11549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:44.835708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:59219 (local address 127.1.55.254:41213)
0620 22:04:44.835780 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:44.835782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:44.835943 (+ 161us) server_negotiation.cc:407] Connection header received
0620 22:04:44.836363 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:44.836364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:44.836373 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:44.836420 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:44.837218 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.837710 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.838600 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.838777 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.838823 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:44.840950 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:44.840951 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:44.840952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:44.840959 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:44.842488 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:44.843043 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:44.843044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:44.843044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:44.843090 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:44.843362 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:44.843363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:44.843363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:44.843450 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:44.843498 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:44.843780 (+ 282us) server_negotiation.cc:299] Negotiation successful
0620 22:04:44.843870 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260620 22:04:44.844448 11700 heartbeater.cc:347] Connected to a master server at 127.1.55.254:41213
I20260620 22:04:44.844545 11700 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:44.844722 11700 heartbeater.cc:511] Master 127.1.55.254:41213 requested a full tablet report, sending...
I20260620 22:04:44.845256 11509 ts_manager.cc:194] Registered new tserver with Master: 3662a2e705e64982bcfaad9da466fa05 (127.1.55.193:46475)
I20260620 22:04:44.845952 11509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:59219
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:04:44.864132 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:41213
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:44.941689 11705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:44.941869 11705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:44.941890 11705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:44.942945 11705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:44.942981 11705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:44.943005 11705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:04:44.944294 11705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:41213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:44.944486 11705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:44.944686 11705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:44.949225 11711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:44.949215 11710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:44.949218 11705 server_base.cc:1034] running on GCE node
W20260620 22:04:44.949267 11713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:44.949653 11705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:44.949887 11705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:44.951056 11705 hybrid_clock.cc:648] HybridClock initialized: now 1781993084951049 us; error 29 us; skew 500 ppm
Jun 20 22:04:44 dist-test-slave-xw35 krb5kdc[11464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993084, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:44.953229 11705 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:04:44.953680 11705 webserver.cc:460] Webserver started at http://127.1.55.194:41507/ using document root <none> and password file <none>
I20260620 22:04:44.953883 11705 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:44.953939 11705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:44.954048 11705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:44.954922 11705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "9b08e3d3849f40a39eecd26bc599a6bd"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "131f7e58edcfef8f332a7240e4a2517c"
server_key_iv: "1138587d5f6ffcbe7e7a4fd953092fde"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.955240 11705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "9b08e3d3849f40a39eecd26bc599a6bd"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "131f7e58edcfef8f332a7240e4a2517c"
server_key_iv: "1138587d5f6ffcbe7e7a4fd953092fde"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.956492 11705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:04:44.957100 11720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:44.957234 11705 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:44.957345 11705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "9b08e3d3849f40a39eecd26bc599a6bd"
format_stamp: "Formatted at 2026-06-20 22:04:44 on dist-test-slave-xw35"
server_key: "131f7e58edcfef8f332a7240e4a2517c"
server_key_iv: "1138587d5f6ffcbe7e7a4fd953092fde"
server_key_version: "encryptionkey@0"
I20260620 22:04:44.957392 11705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:44.970933 11705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:44.972514 11705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:44.972611 11705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:44.972757 11705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:44.972954 11705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:44.972977 11705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:44.972993 11705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:44.973004 11705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:44.978017 11705 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:36267
I20260620 22:04:44.978051 11833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:36267 every 8 connection(s)
I20260620 22:04:44.978293 11705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:04:44 dist-test-slave-xw35 krb5kdc[11464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993084, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:04:44.986147 11549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:44.978809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:46779 (local address 127.1.55.254:41213)
0620 22:04:44.978864 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:44.978866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:44.979048 (+ 182us) server_negotiation.cc:407] Connection header received
0620 22:04:44.979420 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:44.979421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:44.979449 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:44.979499 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:44.980269 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.980750 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.981661 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.981841 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.981907 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:44.983711 (+ 1804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:44.983712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:44.983713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:44.983718 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:44.984789 (+ 1071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:44.985250 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:44.985251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:44.985251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:44.985320 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:44.985630 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:44.985630 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:44.985631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:44.985770 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:44.985832 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:44.986033 (+ 201us) server_negotiation.cc:299] Negotiation successful
0620 22:04:44.986091 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:04:44.986320 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:44.978790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:41213 (local address 127.1.55.194:46779)
0620 22:04:44.978918 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:44.978955 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:44.979348 (+ 393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:44.979546 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:44.979549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:44.980040 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:44.980202 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:44.980205 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.980826 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.980827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:44.981577 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:44.981579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:44.981923 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:44.981924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:44.982009 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:44.982460 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:44.982471 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:44.983641 (+ 1170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:44.984881 (+ 1240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:44.984888 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:44.984890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:44.985175 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:44.985387 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:44.985388 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:44.985388 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:44.985547 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:44.985841 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:44.985846 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:44.985939 (+ 93us) client_negotiation.cc:769] Sending connection context
0620 22:04:44.986017 (+ 78us) client_negotiation.cc:240] Negotiation successful
0620 22:04:44.986117 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":59,"threads_started":1}
I20260620 22:04:44.986729 11834 heartbeater.cc:347] Connected to a master server at 127.1.55.254:41213
I20260620 22:04:44.986797 11834 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:44.986961 11834 heartbeater.cc:511] Master 127.1.55.254:41213 requested a full tablet report, sending...
I20260620 22:04:44.987277 11509 ts_manager.cc:194] Registered new tserver with Master: 9b08e3d3849f40a39eecd26bc599a6bd (127.1.55.194:36267)
I20260620 22:04:44.987691 11509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:46779
I20260620 22:04:44.988121 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 11705
I20260620 22:04:44.988232 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:04:44.988428 1247 external_mini_cluster.cc:1428] Setting key 39355472c7e5c5a51900586ace887b56
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:04:45.011626 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:41213
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:04:45.085511 11839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:04:45.085707 11839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:04:45.085740 11839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:04:45.086732 11839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:04:45.086789 11839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:04:45.086829 11839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:04:45.088270 11839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:41213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:04:45.088518 11839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:04:45.088742 11839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:04:45.093163 11847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:45.093243 11839 server_base.cc:1034] running on GCE node
W20260620 22:04:45.093168 11844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:04:45.093144 11845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:04:45.093567 11839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:04:45.093842 11839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:04:45.094986 11839 hybrid_clock.cc:648] HybridClock initialized: now 1781993085094984 us; error 34 us; skew 500 ppm
Jun 20 22:04:45 dist-test-slave-xw35 krb5kdc[11464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993085, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:04:45.097244 11839 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:04:45.097690 11839 webserver.cc:460] Webserver started at http://127.1.55.195:45903/ using document root <none> and password file <none>
I20260620 22:04:45.097904 11839 fs_manager.cc:359] Metadata directory not provided
I20260620 22:04:45.097976 11839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:04:45.098086 11839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:04:45.099009 11839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "6625bb44bb664b66bd55744eb4030188"
format_stamp: "Formatted at 2026-06-20 22:04:45 on dist-test-slave-xw35"
server_key: "49fed0f166cf8b96a6de7641104fdd69"
server_key_iv: "5a0b3a15763f5aeb779fbdd0f7a70f6f"
server_key_version: "encryptionkey@0"
I20260620 22:04:45.099328 11839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "6625bb44bb664b66bd55744eb4030188"
format_stamp: "Formatted at 2026-06-20 22:04:45 on dist-test-slave-xw35"
server_key: "49fed0f166cf8b96a6de7641104fdd69"
server_key_iv: "5a0b3a15763f5aeb779fbdd0f7a70f6f"
server_key_version: "encryptionkey@0"
I20260620 22:04:45.100443 11839 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:04:45.101126 11854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:45.101285 11839 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:04:45.101380 11839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "6625bb44bb664b66bd55744eb4030188"
format_stamp: "Formatted at 2026-06-20 22:04:45 on dist-test-slave-xw35"
server_key: "49fed0f166cf8b96a6de7641104fdd69"
server_key_iv: "5a0b3a15763f5aeb779fbdd0f7a70f6f"
server_key_version: "encryptionkey@0"
I20260620 22:04:45.101460 11839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:04:45.113886 11839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:04:45.115373 11839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:04:45.115507 11839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:04:45.115689 11839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:04:45.115955 11839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:04:45.116004 11839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:45.116034 11839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:04:45.116060 11839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:04:45.121254 11839 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:45755
I20260620 22:04:45.121287 11967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:45755 every 8 connection(s)
I20260620 22:04:45.121577 11839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:04:45.125240 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 11839
I20260620 22:04:45.125334 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:04:45.125550 1247 external_mini_cluster.cc:1428] Setting key 63d4fadb4ce5a1bc8cf45c6b3a65f743
Jun 20 22:04:45 dist-test-slave-xw35 krb5kdc[11464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993085, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:04:45.129840 11549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.122272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:40251 (local address 127.1.55.254:41213)
0620 22:04:45.122325 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:45.122327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:45.122470 (+ 143us) server_negotiation.cc:407] Connection header received
0620 22:04:45.122830 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:45.122831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:45.122839 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:45.122885 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:45.123695 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.124212 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.125084 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.125402 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.125461 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.127641 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:45.127643 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:45.127643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:45.127663 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:45.128878 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:45.129200 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:45.129201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:45.129201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:45.129245 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:45.129385 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:45.129385 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:45.129385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:45.129464 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:45.129552 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:45.129731 (+ 179us) server_negotiation.cc:299] Negotiation successful
0620 22:04:45.129785 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 22:04:45.129964 11970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.122231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:41213 (local address 127.1.55.195:40251)
0620 22:04:45.122361 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:45.122394 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:45.122762 (+ 368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:45.122934 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:45.122937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:45.123454 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:04:45.123619 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.123623 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.124284 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.124284 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.125008 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.125009 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.125506 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.125507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.125670 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.126174 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:04:45.126182 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:04:45.127554 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:04:45.128938 (+ 1384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:45.128943 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:45.128944 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:45.129140 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:45.129284 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:04:45.129284 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:04:45.129284 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:04:45.129353 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:04:45.129555 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:04:45.129558 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:04:45.129650 (+ 92us) client_negotiation.cc:769] Sending connection context
0620 22:04:45.129719 (+ 69us) client_negotiation.cc:240] Negotiation successful
0620 22:04:45.129811 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":73,"threads_started":1}
I20260620 22:04:45.130438 11968 heartbeater.cc:347] Connected to a master server at 127.1.55.254:41213
I20260620 22:04:45.130517 11968 heartbeater.cc:464] Registering TS with master...
I20260620 22:04:45.130647 11968 heartbeater.cc:511] Master 127.1.55.254:41213 requested a full tablet report, sending...
I20260620 22:04:45.131008 11509 ts_manager.cc:194] Registered new tserver with Master: 6625bb44bb664b66bd55744eb4030188 (127.1.55.195:45755)
I20260620 22:04:45.131318 11509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:40251
I20260620 22:04:45.136878 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:04:45.143131 11549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.138073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54476 (local address 127.1.55.254:41213)
0620 22:04:45.138130 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:45.138131 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:45.138215 (+ 84us) server_negotiation.cc:407] Connection header received
0620 22:04:45.138259 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:45.138259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:45.138266 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:45.138314 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:04:45.138776 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.139172 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.139819 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.139965 (+ 146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.140007 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.141099 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:04:45.141100 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:04:45.141100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:04:45.141105 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:04:45.142311 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:45.142596 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:45.142597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:45.142597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:45.142641 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:04:45.142786 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:04:45.142786 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:04:45.142786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:04:45.142884 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:04:45.142947 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:45.143022 (+ 75us) server_negotiation.cc:299] Negotiation successful
0620 22:04:45.143071 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 22:04:45.144307 11509 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54476:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:04:45.145743 11509 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:04:45.151365 11978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.147790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:36267 (local address 127.0.0.1:59242)
0620 22:04:45.148054 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:45.148064 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:45.148124 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:45.148412 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:45.148413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:45.148414 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:45.148455 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.148457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.149680 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.149681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.150344 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.150346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.151097 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.151098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.151170 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.151183 (+ 13us) client_negotiation.cc:769] Sending connection context
0620 22:04:45.151255 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 22:04:45.151297 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":3,"thread_start_us":36,"threads_started":1}
I20260620 22:04:45.151394 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.147910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59242 (local address 127.1.55.194:36267)
0620 22:04:45.148063 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:45.148067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:45.148185 (+ 118us) server_negotiation.cc:407] Connection header received
0620 22:04:45.148228 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:45.148230 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:45.148246 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:45.148341 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:45.148530 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.149578 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.150442 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.151019 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.151090 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.151149 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:45.151279 (+ 130us) server_negotiation.cc:299] Negotiation successful
0620 22:04:45.151320 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260620 22:04:45.152094 11981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.148082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41540 (local address 127.1.55.195:45755)
0620 22:04:45.148237 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:45.148241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:45.148249 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:04:45.148277 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:45.148279 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:45.148291 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:45.148364 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:45.148557 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.149277 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.150966 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.151670 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.151734 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.151778 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:45.152001 (+ 223us) server_negotiation.cc:299] Negotiation successful
0620 22:04:45.152030 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260620 22:04:45.152107 11980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.147920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:45755 (local address 127.0.0.1:41540)
0620 22:04:45.148123 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:45.148134 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:45.148183 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:45.148426 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:45.148427 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:45.148429 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:45.148480 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.148482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.149381 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.149382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.150891 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.150893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.151809 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.151811 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.151871 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.151875 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:04:45.151973 (+ 98us) client_negotiation.cc:240] Negotiation successful
0620 22:04:45.152023 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":48,"thread_start_us":81,"threads_started":1}
I20260620 22:04:45.152171 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.147700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51042 (local address 127.1.55.193:46475)
0620 22:04:45.147885 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:45.147889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:45.147899 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:04:45.147938 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:45.147940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:45.147958 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:45.148049 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:45.148281 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.149420 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.150750 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.151671 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.151736 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.151790 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:45.152062 (+ 272us) server_negotiation.cc:299] Negotiation successful
0620 22:04:45.152098 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":77,"threads_started":1}
I20260620 22:04:45.152202 11976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.147555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:46475 (local address 127.0.0.1:51042)
0620 22:04:45.147717 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:45.147742 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:45.147817 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:45.148139 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:45.148142 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:45.148144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:45.148201 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.148203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.149543 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.149544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.150655 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.150657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.151823 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.151824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.151887 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.151891 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:04:45.151949 (+ 58us) client_negotiation.cc:240] Negotiation successful
0620 22:04:45.151998 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":33,"thread_start_us":98,"threads_started":1}
I20260620 22:04:45.152130 11768 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec6aea612d54aefb45bfd6f2554c7b5 (DEFAULT_TABLE table=test-table [id=1272399c82e24cdc9a6ab64a70e3eddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:45.152405 11768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec6aea612d54aefb45bfd6f2554c7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:45.154081 11902 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec6aea612d54aefb45bfd6f2554c7b5 (DEFAULT_TABLE table=test-table [id=1272399c82e24cdc9a6ab64a70e3eddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:45.154120 11634 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec6aea612d54aefb45bfd6f2554c7b5 (DEFAULT_TABLE table=test-table [id=1272399c82e24cdc9a6ab64a70e3eddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:04:45.154320 11902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec6aea612d54aefb45bfd6f2554c7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:45.154433 11634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec6aea612d54aefb45bfd6f2554c7b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:04:45.155313 11982 tablet_bootstrap.cc:492] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Bootstrap starting.
I20260620 22:04:45.155984 11982 tablet_bootstrap.cc:654] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:45.156518 11982 log.cc:824] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:45.157135 11984 tablet_bootstrap.cc:492] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: Bootstrap starting.
I20260620 22:04:45.157233 11982 tablet_bootstrap.cc:492] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: No bootstrap required, opened a new log
I20260620 22:04:45.157317 11982 ts_tablet_manager.cc:1397] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:04:45.157425 11985 tablet_bootstrap.cc:492] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05: Bootstrap starting.
I20260620 22:04:45.157764 11984 tablet_bootstrap.cc:654] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:45.158068 11985 tablet_bootstrap.cc:654] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05: Neither blocks nor log segments found. Creating new log.
I20260620 22:04:45.158253 11984 log.cc:824] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:45.158573 11985 log.cc:824] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05: Log is configured to *not* fsync() on all Append() calls
I20260620 22:04:45.158926 11984 tablet_bootstrap.cc:492] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: No bootstrap required, opened a new log
I20260620 22:04:45.158999 11984 ts_tablet_manager.cc:1397] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 22:04:45.159387 11985 tablet_bootstrap.cc:492] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05: No bootstrap required, opened a new log
I20260620 22:04:45.159453 11985 ts_tablet_manager.cc:1397] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:04:45.159375 11982 raft_consensus.cc:348] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.159555 11982 raft_consensus.cc:374] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:45.159593 11982 raft_consensus.cc:729] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b08e3d3849f40a39eecd26bc599a6bd, State: Initialized, Role: FOLLOWER
I20260620 22:04:45.159694 11982 consensus_queue.cc:260] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.159994 11982 ts_tablet_manager.cc:1428] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:04:45.160212 11834 heartbeater.cc:503] Master 127.1.55.254:41213 was elected leader, sending a full tablet report...
I20260620 22:04:45.160903 11984 raft_consensus.cc:348] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.161051 11984 raft_consensus.cc:374] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:45.161093 11984 raft_consensus.cc:729] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6625bb44bb664b66bd55744eb4030188, State: Initialized, Role: FOLLOWER
I20260620 22:04:45.161204 11984 consensus_queue.cc:260] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.161528 11984 ts_tablet_manager.cc:1428] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260620 22:04:45.161561 11968 heartbeater.cc:503] Master 127.1.55.254:41213 was elected leader, sending a full tablet report...
I20260620 22:04:45.161607 11985 raft_consensus.cc:348] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.161734 11985 raft_consensus.cc:374] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:04:45.161769 11985 raft_consensus.cc:729] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3662a2e705e64982bcfaad9da466fa05, State: Initialized, Role: FOLLOWER
I20260620 22:04:45.161878 11985 consensus_queue.cc:260] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.162225 11700 heartbeater.cc:503] Master 127.1.55.254:41213 was elected leader, sending a full tablet report...
I20260620 22:04:45.162204 11985 ts_tablet_manager.cc:1428] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260620 22:04:45.228744 11835 tablet.cc:2369] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:04:45.245146 11988 raft_consensus.cc:482] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:04:45.245219 11988 raft_consensus.cc:504] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.245491 11988 leader_election.cc:288] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3662a2e705e64982bcfaad9da466fa05 (127.1.55.193:46475), 6625bb44bb664b66bd55744eb4030188 (127.1.55.195:45755)
I20260620 22:04:45.247999 11836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.245638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:46475 (local address 127.1.55.194:38569)
0620 22:04:45.245690 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:45.245700 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:45.245738 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:45.245868 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:45.245869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:45.245871 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:45.245938 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.245939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.246514 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.246515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.247187 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.247189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.247745 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.247746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.247827 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.247830 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:04:45.247889 (+ 59us) client_negotiation.cc:240] Negotiation successful
0620 22:04:45.247931 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260620 22:04:45.247999 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.245696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:38569 (local address 127.1.55.193:46475)
0620 22:04:45.245755 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:45.245758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:45.245767 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:04:45.245792 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:45.245793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:45.245804 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:45.245861 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:45.246004 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.246427 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.247283 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.247653 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.247735 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.247744 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:45.247907 (+ 163us) server_negotiation.cc:299] Negotiation successful
0620 22:04:45.247942 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260620 22:04:45.248256 11981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.245810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:54057 (local address 127.1.55.195:45755)
0620 22:04:45.245859 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:45.245860 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:45.245957 (+ 97us) server_negotiation.cc:407] Connection header received
0620 22:04:45.246011 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:45.246012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:45.246020 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:45.246063 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:04:45.246207 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.246621 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.247469 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.247857 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.247943 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.247950 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:45.248146 (+ 196us) server_negotiation.cc:299] Negotiation successful
0620 22:04:45.248192 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:04:45.248320 11654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec6aea612d54aefb45bfd6f2554c7b5" candidate_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3662a2e705e64982bcfaad9da466fa05" is_pre_election: true
I20260620 22:04:45.248450 11991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.245745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:45755 (local address 127.1.55.194:54057)
0620 22:04:45.245892 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:45.245899 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0620 22:04:45.245963 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:04:45.246079 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:04:45.246079 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:04:45.246081 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:04:45.246148 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.246150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.246705 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.246706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.247387 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:04:45.247388 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.247943 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.247944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:04:45.248018 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.248024 (+ 6us) client_negotiation.cc:769] Sending connection context
0620 22:04:45.248343 (+ 319us) client_negotiation.cc:240] Negotiation successful
0620 22:04:45.248385 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260620 22:04:45.248466 11654 raft_consensus.cc:2454] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b08e3d3849f40a39eecd26bc599a6bd in term 0.
I20260620 22:04:45.248659 11724 leader_election.cc:302] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3662a2e705e64982bcfaad9da466fa05, 9b08e3d3849f40a39eecd26bc599a6bd; no voters:
I20260620 22:04:45.248737 11922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec6aea612d54aefb45bfd6f2554c7b5" candidate_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6625bb44bb664b66bd55744eb4030188" is_pre_election: true
I20260620 22:04:45.248816 11988 raft_consensus.cc:2781] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:04:45.248883 11988 raft_consensus.cc:482] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:04:45.248903 11922 raft_consensus.cc:2454] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b08e3d3849f40a39eecd26bc599a6bd in term 0.
I20260620 22:04:45.248917 11988 raft_consensus.cc:3037] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:45.249601 11988 raft_consensus.cc:504] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.249720 11988 leader_election.cc:288] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [CANDIDATE]: Term 1 election: Requested vote from peers 3662a2e705e64982bcfaad9da466fa05 (127.1.55.193:46475), 6625bb44bb664b66bd55744eb4030188 (127.1.55.195:45755)
I20260620 22:04:45.249879 11654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec6aea612d54aefb45bfd6f2554c7b5" candidate_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3662a2e705e64982bcfaad9da466fa05"
I20260620 22:04:45.249910 11922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec6aea612d54aefb45bfd6f2554c7b5" candidate_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6625bb44bb664b66bd55744eb4030188"
I20260620 22:04:45.249963 11922 raft_consensus.cc:3037] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:45.249958 11654 raft_consensus.cc:3037] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:04:45.250761 11922 raft_consensus.cc:2454] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b08e3d3849f40a39eecd26bc599a6bd in term 1.
I20260620 22:04:45.250761 11654 raft_consensus.cc:2454] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b08e3d3849f40a39eecd26bc599a6bd in term 1.
I20260620 22:04:45.250929 11724 leader_election.cc:302] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3662a2e705e64982bcfaad9da466fa05, 9b08e3d3849f40a39eecd26bc599a6bd; no voters:
I20260620 22:04:45.251031 11988 raft_consensus.cc:2781] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:04:45.251158 11988 raft_consensus.cc:686] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 1 LEADER]: Becoming Leader. State: Replica: 9b08e3d3849f40a39eecd26bc599a6bd, State: Running, Role: LEADER
I20260620 22:04:45.251246 11988 consensus_queue.cc:237] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } }
I20260620 22:04:45.251986 11509 catalog_manager.cc:5495] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b08e3d3849f40a39eecd26bc599a6bd (127.1.55.194). New cstate: current_term: 1 leader_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b08e3d3849f40a39eecd26bc599a6bd" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 36267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 } health_report { overall_health: UNKNOWN } } }
I20260620 22:04:45.267118 11979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.264710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59254 (local address 127.1.55.194:36267)
0620 22:04:45.264761 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:04:45.264763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:04:45.264771 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:04:45.264851 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:04:45.264852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:04:45.264869 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:04:45.264935 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:04:45.265073 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.265580 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.266328 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:04:45.266527 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:04:45.266603 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:04:45.266776 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:04:45.266876 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:04:45.266956 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0620 22:04:45.267006 (+ 50us) server_negotiation.cc:299] Negotiation successful
0620 22:04:45.267022 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:04:45.268676 11922 raft_consensus.cc:1261] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 1 FOLLOWER]: Refusing update from remote peer 9b08e3d3849f40a39eecd26bc599a6bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:45.268676 11654 raft_consensus.cc:1261] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 3662a2e705e64982bcfaad9da466fa05 [term 1 FOLLOWER]: Refusing update from remote peer 9b08e3d3849f40a39eecd26bc599a6bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:04:45.268961 11988 consensus_queue.cc:1035] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3662a2e705e64982bcfaad9da466fa05" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 46475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:45.269094 11992 consensus_queue.cc:1035] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6625bb44bb664b66bd55744eb4030188" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:04:45.273524 11508 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:45.273597 11508 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:04:45.274319 11508 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b34fdbd1115a43ee9312fa60dbe30aeb: Sending DeleteTablet for 3 replicas of tablet 4ec6aea612d54aefb45bfd6f2554c7b5
I20260620 22:04:45.274688 11768 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ec6aea612d54aefb45bfd6f2554c7b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:45 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:59242
I20260620 22:04:45.274791 11634 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ec6aea612d54aefb45bfd6f2554c7b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:45 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:51042
I20260620 22:04:45.274901 12004 tablet_replica.cc:330] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: stopping tablet replica
I20260620 22:04:45.274961 11902 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ec6aea612d54aefb45bfd6f2554c7b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:04:45 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:41540
I20260620 22:04:45.274978 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 11571
I20260620 22:04:45.274992 12004 raft_consensus.cc:2229] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:04:45.275080 12004 raft_consensus.cc:2258] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:45.275532 12004 ts_tablet_manager.cc:1905] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:45.276038 12006 tablet_replica.cc:330] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: stopping tablet replica
I20260620 22:04:45.276118 12006 raft_consensus.cc:2229] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:04:45.276201 12006 raft_consensus.cc:2258] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:04:45.276758 12006 ts_tablet_manager.cc:1905] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:04:45.277302 12004 ts_tablet_manager.cc:1918] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:04:45.277369 12004 log.cc:1196] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/4ec6aea612d54aefb45bfd6f2554c7b5
I20260620 22:04:45.277745 12004 ts_tablet_manager.cc:1939] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 9b08e3d3849f40a39eecd26bc599a6bd: Deleting consensus metadata
I20260620 22:04:45.278194 11496 catalog_manager.cc:4841] TS 9b08e3d3849f40a39eecd26bc599a6bd (127.1.55.194:36267): tablet 4ec6aea612d54aefb45bfd6f2554c7b5 (table test-table [id=1272399c82e24cdc9a6ab64a70e3eddb]) successfully deleted
I20260620 22:04:45.278558 12006 ts_tablet_manager.cc:1918] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:04:45.278657 12006 log.cc:1196] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/4ec6aea612d54aefb45bfd6f2554c7b5
I20260620 22:04:45.278893 12006 ts_tablet_manager.cc:1939] T 4ec6aea612d54aefb45bfd6f2554c7b5 P 6625bb44bb664b66bd55744eb4030188: Deleting consensus metadata
I20260620 22:04:45.279302 11496 catalog_manager.cc:4841] TS 6625bb44bb664b66bd55744eb4030188 (127.1.55.195:45755): tablet 4ec6aea612d54aefb45bfd6f2554c7b5 (table test-table [id=1272399c82e24cdc9a6ab64a70e3eddb]) successfully deleted
W20260620 22:04:45.281255 11496 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:46475 (error 108)
I20260620 22:04:45.281607 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 11705
I20260620 22:04:45.281817 11976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:04:45.281690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:46475 (local address 127.0.0.1:51050)
0620 22:04:45.281734 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0620 22:04:45.281778 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:46475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260620 22:04:45.281919 11496 catalog_manager.cc:4584] TS 3662a2e705e64982bcfaad9da466fa05 (127.1.55.193:46475): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4ec6aea612d54aefb45bfd6f2554c7b5: Network error: Client connection negotiation failed: client connection to 127.1.55.193:46475: connect: Connection refused (error 111)
I20260620 22:04:45.287904 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 11839
I20260620 22:04:45.292121 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 11477
2026-06-20T22:04:45Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1854 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:04:45 dist-test-slave-xw35 krb5kdc[12010](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:04:45 dist-test-slave-xw35 krb5kdc[12010](info): set up 2 sockets
Jun 20 22:04:45 dist-test-slave-xw35 krb5kdc[12010](info): commencing operation
krb5kdc: starting...
W20260620 22:04:46.301577 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.990s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:04:46 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993086, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:04:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:04:46Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.55.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.55.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/rangeradmin_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/rangeradmin_127.1.55.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.55.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.55.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/rangerlookup_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/rangerlookup_127.1.55.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.55.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.55.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/HTTP_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/HTTP_127.1.55.212@KRBTEST.COM.keytab.
I20260620 22:04:46.448766 1247 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskKulyh2/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/postgres -l logfile start
2026-06-20 22:04:48.693 UTC [12040] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-20 22:04:48.693 UTC [12040] LOG: listening on IPv4 address "127.1.55.212", port 51997
2026-06-20 22:04:48.696 UTC [12040] LOG: listening on Unix socket "/tmp/.s.PGSQL.51997"
2026-06-20 22:04:48.727 UTC [12043] LOG: database system was shut down at 2026-06-20 22:04:47 UTC
2026-06-20 22:04:48.731 UTC [12040] LOG: database system is ready to accept connections
I20260620 22:04:49.645418 1247 mini_postgres.cc:96] Postgres bound to 51997
2026-06-20 22:04:49.651 UTC [12051] FATAL: database "slave" does not exist
127.1.55.212:51997 - accepting connections
I20260620 22:04:49.651629 1247 mini_ranger.cc:161] Starting Ranger...
I20260620 22:04:49.664665 1247 mini_ranger.cc:84] Created miniranger Postgres user
I20260620 22:04:50.073186 1247 mini_ranger.cc:87] Created ranger Postgres database
I20260620 22:04:50.073271 1247 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-admin
2026-06-20 22:04:50,331 [I] DB FLAVOR :POSTGRES
2026-06-20 22:04:50,331 [I] --------- Verifying Ranger DB connection ---------
2026-06-20 22:04:50,331 [I] Checking connection..
2026-06-20 22:04:50,331 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-20 22:04:50,575 [I] Checking connection passed.
2026-06-20 22:04:50,575 [I] --------- Verifying version history table ---------
2026-06-20 22:04:50,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 22:04:50,804 [I] Table x_db_version_h does not exist in database ranger
2026-06-20 22:04:50,804 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 22:04:51,046 [I] Table x_db_version_h does not exist in database ranger
2026-06-20 22:04:51,046 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-20 22:04:51,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-20 22:04:51.278 UTC [12115] WARNING: there is no transaction in progress
2026-06-20 22:04:51,284 [I] create_dbversion_catalog.sql file imported successfully
2026-06-20 22:04:51,284 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 22:04:51,523 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-20 22:04:51,524 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-20 22:04:51,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-20 22:04:51,747 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-20 22:04:51,975 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-xw35.c.gcp-upstream.internal','N') ;"
2026-06-20 22:04:52,210 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-20 22:04:52,416 [I] Table x_portal_user does not exist in database ranger
2026-06-20 22:04:52,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-20 22:04:52,625 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-20 22:04:52,626 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-20 22:04:52,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-20 22:04:53,070 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-20 22:04:53,070 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-20 22:04:53.928 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:53.942 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:53.956 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:53.969 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:53.982 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.000 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.060 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.066 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.079 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.087 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.096 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.108 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.116 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.122 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.128 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54.134 UTC [12223] WARNING: there is no transaction in progress
2026-06-20 22:04:54,681 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-20 22:04:54,682 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-20 22:04:54,890 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-20 22:04:54,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-20 22:04:55,106 [I] Table x_portal_user already exists in database 'ranger'
2026-06-20 22:04:55,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-20 22:04:55,337 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-20 22:04:55,337 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-20 22:04:55,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-20 22:04:55,802 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-xw35.c.gcp-upstream.internal';"
2026-06-20 22:04:56,038 [I] CORE_DB_SCHEMA import status has been updated
2026-06-20 22:04:56,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-20 22:04:56,253 [I] DB_PATCHES have already been applied
I20260620 22:04:56.258671 1247 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-admin:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskKulyh2/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260620 22:04:56.258726 1247 mini_ranger.cc:193] Using host: 127.1.55.212
I20260620 22:04:56.261565 1247 mini_ranger.cc:227] Ranger admin URL: http://127.1.55.212:35751
Jun 20, 2026 10:04:56 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 20, 2026 10:04:56 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 20, 2026 10:04:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-admin/ews/webapp
Jun 20, 2026 10:04:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 20, 2026 10:04:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 20, 2026 10:04:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-admin/ews/webapp].
Jun 20, 2026 10:04:57 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260620 22:04:57.319018 1247 mini_ranger.cc:160] Time spent starting Ranger: real 7.667s user 0.000s sys 0.008s
Jun 20, 2026 10:05:15 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 20, 2026 10:05:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Jun 20, 2026 10:05:15 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 20, 2026 10:05:15 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 20, 2026 10:05:16 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260620 22:05:16.721457 1247 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.55.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.55.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/rangerkms_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/rangerkms_127.1.55.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.55.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.55.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.55.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/HTTP_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.55.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/HTTP_127.1.55.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 20 22:05:16 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993116, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260620 22:05:16.795512 1247 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260620 22:05:16.804040 1247 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260620 22:05:17.550854 1247 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260620 22:05:17.550931 1247 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms
I20260620 22:05:17.550944 1247 mini_ranger_kms.cc:227] Using postgres at 127.1.55.212:51997
2026-06-20 22:05:17,725 [I] DB FLAVOR :POSTGRES
2026-06-20 22:05:17,725 [I] --------- Verifying Ranger DB connection ---------
2026-06-20 22:05:17,725 [I] Checking connection
2026-06-20 22:05:17,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-20 22:05:17,943 [I] connection success
2026-06-20 22:05:17,943 [I] --------- Verifying Ranger DB tables ---------
2026-06-20 22:05:17,943 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-20 22:05:17,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-20 22:05:18,184 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-20 22:05:18,184 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-20 22:05:18,184 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-20 22:05:18,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:51997/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-20 22:05:18,429 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260620 22:05:18.869975 1247 mini_ranger_kms.cc:310] Created kms service
I20260620 22:05:19.025921 1247 mini_ranger_kms.cc:326] Created kudu user
I20260620 22:05:19.077910 1247 mini_ranger_kms.cc:343] Created rangerkms user
Jun 20 22:05:19 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993116, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:05:19.428321 1247 mini_ranger_kms.cc:384] Added ranger policy
I20260620 22:05:19.428431 1247 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms:/tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260620 22:05:19.428452 1247 mini_ranger_kms.cc:240] Using host: 127.1.55.212
I20260620 22:05:19.431813 1247 mini_ranger_kms.cc:276] Ranger KMS PID: 12403
I20260620 22:05:19.431905 1247 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.55.212:48699
Jun 20, 2026 10:05:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 20, 2026 10:05:20 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 20, 2026 10:05:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 20, 2026 10:05:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 20, 2026 10:05:20 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-kms/ews/webapp].
Jun 20, 2026 10:05:20 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Jun 20 22:05:21 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781993121, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.55.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:05:21.557693 1247 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.762s user 0.000s sys 0.157s
I20260620 22:05:21.557792 1247 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260620 22:05:21.557871 1247 mini_ranger_kms.cc:401] 127.1.55.212:48699/kms/v1/keys
Jun 20 22:05:21 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993121, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.55.212@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
Jun 20 22:05:22 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993121, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.55.212@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
Jun 20 22:05:24 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:05:24.270799 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45331
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:40303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45331
--ranger_config_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:48699/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:05:24.347374 12454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:05:24.347618 12454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:05:24.347666 12454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:05:24.348776 12454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:05:24.348845 12454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:05:24.348866 12454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:05:24.348886 12454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:05:24.348912 12454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:05:24.350356 12454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.55.212:48699/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45331
--ranger_config_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:05:24.350610 12454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:05:24.350816 12454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:05:24.355675 12459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:05:24.355777 12454 server_base.cc:1034] running on GCE node
W20260620 22:05:24.355715 12460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:05:24.355911 12462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:05:24.356168 12454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:05:24.356452 12454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:05:24.357594 12454 hybrid_clock.cc:648] HybridClock initialized: now 1781993124357574 us; error 35 us; skew 500 ppm
Jun 20 22:05:24 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993124, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:05:24.360214 12454 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:05:24.360729 12454 webserver.cc:460] Webserver started at http://127.1.55.254:38117/ using document root <none> and password file <none>
I20260620 22:05:24.360976 12454 fs_manager.cc:359] Metadata directory not provided
I20260620 22:05:24.361034 12454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:05:24.361179 12454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 22:05:24 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993124, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:05:24.402311 12454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "9710c00c06ce40b893e9417a352676e2"
format_stamp: "Formatted at 2026-06-20 22:05:24 on dist-test-slave-xw35"
server_key: "d6dc8fcd5198c2a6e0005301f6c8487b"
server_key_iv: "8425054d122ed450c34e4766f5f0b484"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:24.402699 12454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "9710c00c06ce40b893e9417a352676e2"
format_stamp: "Formatted at 2026-06-20 22:05:24 on dist-test-slave-xw35"
server_key: "d6dc8fcd5198c2a6e0005301f6c8487b"
server_key_iv: "8425054d122ed450c34e4766f5f0b484"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:24.404042 12454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:05:24.416872 12469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:24.417104 12454 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 22:05:24.417204 12454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "9710c00c06ce40b893e9417a352676e2"
format_stamp: "Formatted at 2026-06-20 22:05:24 on dist-test-slave-xw35"
server_key: "d6dc8fcd5198c2a6e0005301f6c8487b"
server_key_iv: "8425054d122ed450c34e4766f5f0b484"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:24.417274 12454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:05:24.439051 12454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:05:24.440831 12454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:05:24.440975 12454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:05:24.446364 12454 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:45331
I20260620 22:05:24.446400 12521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:45331 every 8 connection(s)
I20260620 22:05:24.446789 12454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:05:24.447407 12522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:05:24.449532 12522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2: Bootstrap starting.
I20260620 22:05:24.450037 12522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2: Neither blocks nor log segments found. Creating new log.
I20260620 22:05:24.450302 12522 log.cc:824] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2: Log is configured to *not* fsync() on all Append() calls
I20260620 22:05:24.450922 12522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2: No bootstrap required, opened a new log
I20260620 22:05:24.452731 12522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9710c00c06ce40b893e9417a352676e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45331 } }
I20260620 22:05:24.452883 12522 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:05:24.452926 12522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9710c00c06ce40b893e9417a352676e2, State: Initialized, Role: FOLLOWER
I20260620 22:05:24.453081 12522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9710c00c06ce40b893e9417a352676e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45331 } }
I20260620 22:05:24.453176 12522 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:05:24.453229 12522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:05:24.453271 12522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:05:24.453877 12522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9710c00c06ce40b893e9417a352676e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45331 } }
I20260620 22:05:24.453987 12522 leader_election.cc:302] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9710c00c06ce40b893e9417a352676e2; no voters:
I20260620 22:05:24.454175 12522 leader_election.cc:288] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:05:24.454196 12525 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:05:24.454355 12525 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [term 1 LEADER]: Becoming Leader. State: Replica: 9710c00c06ce40b893e9417a352676e2, State: Running, Role: LEADER
I20260620 22:05:24.454458 12522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:05:24.454490 12525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9710c00c06ce40b893e9417a352676e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45331 } }
I20260620 22:05:24.454818 12525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9710c00c06ce40b893e9417a352676e2. Latest consensus state: current_term: 1 leader_uuid: "9710c00c06ce40b893e9417a352676e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9710c00c06ce40b893e9417a352676e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45331 } } }
I20260620 22:05:24.454828 12526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9710c00c06ce40b893e9417a352676e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9710c00c06ce40b893e9417a352676e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45331 } } }
I20260620 22:05:24.454950 12525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [sys.catalog]: This master's current role is: LEADER
I20260620 22:05:24.455183 12526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2 [sys.catalog]: This master's current role is: LEADER
I20260620 22:05:24.455228 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 12454
I20260620 22:05:24.455731 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:05:24.455957 1247 external_mini_cluster.cc:1428] Setting key fcf6a5e77bb2e88cca2a792bdce26251
I20260620 22:05:24.456374 12522 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260620 22:05:24.459121 12534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:05:24.460523 12534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:05:24.467582 12534 catalog_manager.cc:1347] Generated new cluster ID: 7eef53741fcb4f21a0120ffa63aea7a3
I20260620 22:05:24.467687 12534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:05:24 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:05:24.477617 12541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:24.456424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48654 (local address 127.1.55.254:45331)
0620 22:05:24.459337 (+ 2913us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:24.459352 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:24.459387 (+ 35us) server_negotiation.cc:407] Connection header received
0620 22:05:24.459565 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:24.459571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:24.459629 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:24.459781 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:05:24.460561 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:24.462077 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:24.463118 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:24.463675 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:24.463775 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:24.474018 (+ 10243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:05:24.474022 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:05:24.474023 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:05:24.474034 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:05:24.475907 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:24.476301 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:24.476304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:24.476305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:24.476421 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:24.476629 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:24.476629 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:24.476630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:24.476912 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:05:24.477038 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:24.477201 (+ 163us) server_negotiation.cc:299] Negotiation successful
0620 22:05:24.477337 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2849,"thread_start_us":63,"threads_started":1}
I20260620 22:05:24.482357 12534 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:05:24.483014 12534 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:05:24.491000 12534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2: Generated new TSK 0
I20260620 22:05:24.491217 12534 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:05:25.191421 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:48699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45331
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:40303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:05:25.273624 12567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:05:25.273820 12567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:05:25.273856 12567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:05:25.275040 12567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:05:25.275098 12567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:05:25.275139 12567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:05:25.276582 12567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.55.212:48699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:05:25.276820 12567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:05:25.277034 12567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:05:25.281905 12575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:05:25.282212 12573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:05:25.282370 12567 server_base.cc:1034] running on GCE node
W20260620 22:05:25.282462 12572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:05:25.282660 12567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:05:25.282902 12567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:05:25.284042 12567 hybrid_clock.cc:648] HybridClock initialized: now 1781993125284034 us; error 25 us; skew 500 ppm
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:05:25.286479 12567 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:05:25.286819 12567 webserver.cc:460] Webserver started at http://127.1.55.193:46511/ using document root <none> and password file <none>
I20260620 22:05:25.287014 12567 fs_manager.cc:359] Metadata directory not provided
I20260620 22:05:25.287074 12567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:05:25.287202 12567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:05:25.296613 12567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "93fd1c9409ffc4ae3214a8da567e31d6"
server_key_iv: "c402f7e37559ab1da61a0542a301ff45"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.296969 12567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "93fd1c9409ffc4ae3214a8da567e31d6"
server_key_iv: "c402f7e37559ab1da61a0542a301ff45"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.298475 12567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:05:25.311797 12582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.311980 12567 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:05:25.312072 12567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "93fd1c9409ffc4ae3214a8da567e31d6"
server_key_iv: "c402f7e37559ab1da61a0542a301ff45"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.312148 12567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:05:25.348407 12567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:05:25.350421 12567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:05:25.350561 12567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:05:25.350805 12567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:05:25.351147 12567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:05:25.351195 12567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.351225 12567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:05:25.351253 12567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.358649 12567 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:41831
I20260620 22:05:25.358769 12696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:41831 every 8 connection(s)
I20260620 22:05:25.359089 12567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:05:25.366144 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 12567
I20260620 22:05:25.366261 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:05:25.366451 1247 external_mini_cluster.cc:1428] Setting key b9d736be23d5ee84183e82f07c541bfc
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:05:25.370498 12701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.360666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:48903 (local address 127.1.55.254:45331)
0620 22:05:25.361723 (+ 1057us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:25.361725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:25.361734 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:05:25.361760 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:25.361761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:25.361774 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:25.361839 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:05:25.362553 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.363287 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.364634 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.364828 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.364887 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.367196 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:05:25.367197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:05:25.367198 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:05:25.367205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:05:25.368972 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:25.369412 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:25.369413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:25.369413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:25.369503 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:25.369806 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:25.369807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:25.369807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:25.369944 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:05:25.370021 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:25.370324 (+ 303us) server_negotiation.cc:299] Negotiation successful
0620 22:05:25.370408 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1027,"thread_start_us":65,"threads_started":1}
I20260620 22:05:25.370834 12700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.360630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45331 (local address 127.1.55.193:48903)
0620 22:05:25.360799 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:25.360841 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:25.361540 (+ 699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:25.361958 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:05:25.361962 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:05:25.362192 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:05:25.362449 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.362454 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.363393 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.363394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.364539 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.364542 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.364917 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.364919 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.365057 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.365567 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:05:25.365576 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:05:25.367088 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:05:25.369046 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:05:25.369052 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:05:25.369053 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:05:25.369329 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:05:25.369591 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:05:25.369592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:05:25.369592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:05:25.369730 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:05:25.370023 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:05:25.370028 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:05:25.370176 (+ 148us) client_negotiation.cc:769] Sending connection context
0620 22:05:25.370286 (+ 110us) client_negotiation.cc:240] Negotiation successful
0620 22:05:25.370433 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":75,"threads_started":1}
I20260620 22:05:25.371239 12698 heartbeater.cc:347] Connected to a master server at 127.1.55.254:45331
I20260620 22:05:25.371317 12698 heartbeater.cc:464] Registering TS with master...
I20260620 22:05:25.371464 12698 heartbeater.cc:511] Master 127.1.55.254:45331 requested a full tablet report, sending...
I20260620 22:05:25.371948 12486 ts_manager.cc:194] Registered new tserver with Master: 0d6eecf6b7404bc9aaee37ce6f1db3a2 (127.1.55.193:41831)
I20260620 22:05:25.372784 12486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:48903
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:05:25.394549 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:48699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45331
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:40303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:05:25.500560 12704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:05:25.500797 12704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:05:25.500828 12704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:05:25.502427 12704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:05:25.502478 12704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:05:25.502514 12704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:05:25.504539 12704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.55.212:48699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:05:25.504760 12704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:05:25.505028 12704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:05:25.511327 12714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:05:25.511601 12712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:05:25.511654 12711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:05:25.511978 12704 server_base.cc:1034] running on GCE node
I20260620 22:05:25.512171 12704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:05:25.512420 12704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:05:25.513552 12704 hybrid_clock.cc:648] HybridClock initialized: now 1781993125513536 us; error 31 us; skew 500 ppm
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:05:25.517009 12704 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:05:25.517501 12704 webserver.cc:460] Webserver started at http://127.1.55.194:43871/ using document root <none> and password file <none>
I20260620 22:05:25.517802 12704 fs_manager.cc:359] Metadata directory not provided
I20260620 22:05:25.517872 12704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:05:25.518041 12704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:05:25.532626 12704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "6a9861638809401ab6a26b5f009da3e2"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "f79f3ad5c39ba627ba77127d44dac19b"
server_key_iv: "0d6373408c563b3e709750bace116eeb"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.533110 12704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "6a9861638809401ab6a26b5f009da3e2"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "f79f3ad5c39ba627ba77127d44dac19b"
server_key_iv: "0d6373408c563b3e709750bace116eeb"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.535187 12704 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260620 22:05:25.553561 12721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.553776 12704 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.001s
I20260620 22:05:25.553856 12704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "6a9861638809401ab6a26b5f009da3e2"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "f79f3ad5c39ba627ba77127d44dac19b"
server_key_iv: "0d6373408c563b3e709750bace116eeb"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.553926 12704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:05:25.577805 12704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:05:25.579944 12704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:05:25.580111 12704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:05:25.580327 12704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:05:25.580670 12704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:05:25.580739 12704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.580803 12704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:05:25.580857 12704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.587003 12704 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:41035
I20260620 22:05:25.587447 12704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:05:25.589452 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 12704
I20260620 22:05:25.589605 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:05:25.589818 1247 external_mini_cluster.cc:1428] Setting key ddb510ffe9b18c0d905d38576ef0ebb1
I20260620 22:05:25.599146 12834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:41035 every 8 connection(s)
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:05:25.611689 12701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.600739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:39563 (local address 127.1.55.254:45331)
0620 22:05:25.600790 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:25.600792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:25.601721 (+ 929us) server_negotiation.cc:407] Connection header received
0620 22:05:25.602450 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:25.602451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:25.602467 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:25.602500 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:05:25.603344 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.604082 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.605626 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.605912 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.605957 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.608460 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:05:25.608461 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:05:25.608462 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:05:25.608469 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:05:25.610164 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:25.610628 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:25.610629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:25.610630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:25.610686 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:25.610953 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:25.610954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:25.610954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:25.611078 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:05:25.611119 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:25.611474 (+ 355us) server_negotiation.cc:299] Negotiation successful
0620 22:05:25.611563 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260620 22:05:25.612201 12838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.599768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45331 (local address 127.1.55.194:39563)
0620 22:05:25.601586 (+ 1818us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:25.601634 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:25.602324 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:25.602709 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:05:25.602713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:05:25.602948 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:05:25.603239 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.603245 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.604207 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.604208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.605517 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.605520 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.606048 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.606049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.606197 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.606759 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:05:25.606769 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:05:25.608359 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:05:25.610251 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:05:25.610257 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:05:25.610259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:05:25.610538 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:05:25.610758 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:05:25.610758 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:05:25.610759 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:05:25.610879 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:05:25.611177 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:05:25.611182 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:05:25.611327 (+ 145us) client_negotiation.cc:769] Sending connection context
0620 22:05:25.611837 (+ 510us) client_negotiation.cc:240] Negotiation successful
0620 22:05:25.611981 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1773,"thread_start_us":77,"threads_started":1}
I20260620 22:05:25.612727 12835 heartbeater.cc:347] Connected to a master server at 127.1.55.254:45331
I20260620 22:05:25.612833 12835 heartbeater.cc:464] Registering TS with master...
I20260620 22:05:25.613025 12835 heartbeater.cc:511] Master 127.1.55.254:45331 requested a full tablet report, sending...
I20260620 22:05:25.613373 12486 ts_manager.cc:194] Registered new tserver with Master: 6a9861638809401ab6a26b5f009da3e2 (127.1.55.194:41035)
I20260620 22:05:25.613850 12486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:39563
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:05:25.620852 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:48699/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45331
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:40303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:05:25.730533 12841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:05:25.730835 12841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:05:25.730914 12841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:05:25.732605 12841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:05:25.732707 12841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:05:25.732785 12841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:05:25.734899 12841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.55.212:48699/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:45331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:05:25.735148 12841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:05:25.735360 12841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:05:25.741377 12849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:05:25.741755 12847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:05:25.741989 12846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:05:25.743052 12841 server_base.cc:1034] running on GCE node
I20260620 22:05:25.743251 12841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:05:25.743505 12841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:05:25.744689 12841 hybrid_clock.cc:648] HybridClock initialized: now 1781993125744660 us; error 41 us; skew 500 ppm
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:05:25.748010 12841 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:05:25.748517 12841 webserver.cc:460] Webserver started at http://127.1.55.195:44113/ using document root <none> and password file <none>
I20260620 22:05:25.748807 12841 fs_manager.cc:359] Metadata directory not provided
I20260620 22:05:25.748916 12841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:05:25.749094 12841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:05:25.763477 12841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "e567519378174591ad2ad0ac6a8bfb28"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "cf43188a0d15d39f91c2527c85c26480"
server_key_iv: "1a0b8436d824b593840586c6e0fb2661"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.763860 12841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "e567519378174591ad2ad0ac6a8bfb28"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "cf43188a0d15d39f91c2527c85c26480"
server_key_iv: "1a0b8436d824b593840586c6e0fb2661"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.765223 12841 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:05:25.786092 12856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.786286 12841 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.001s sys 0.000s
I20260620 22:05:25.786370 12841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "e567519378174591ad2ad0ac6a8bfb28"
format_stamp: "Formatted at 2026-06-20 22:05:25 on dist-test-slave-xw35"
server_key: "cf43188a0d15d39f91c2527c85c26480"
server_key_iv: "1a0b8436d824b593840586c6e0fb2661"
server_key_version: "kuduclusterkey@0"
I20260620 22:05:25.786449 12841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:05:25.820497 12841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:05:25.822985 12841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:05:25.823117 12841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:05:25.823343 12841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:05:25.823689 12841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:05:25.823740 12841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.823772 12841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:05:25.823849 12841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:05:25.837013 12841 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:44455
I20260620 22:05:25.837435 12841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:05:25.839037 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 12841
I20260620 22:05:25.839136 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:05:25.839311 1247 external_mini_cluster.cc:1428] Setting key e56932a0273ff9b5bbe87856afe84eaa
I20260620 22:05:25.846015 12969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:44455 every 8 connection(s)
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:05:25.851817 12701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.838384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:51477 (local address 127.1.55.254:45331)
0620 22:05:25.838427 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:25.838429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:25.838685 (+ 256us) server_negotiation.cc:407] Connection header received
0620 22:05:25.839371 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:25.839372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:25.839385 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:25.839415 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:05:25.840299 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.841064 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.845117 (+ 4053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.845414 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.845465 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.848535 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:05:25.848537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:05:25.848537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:05:25.848544 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:05:25.850287 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:25.850760 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:25.850761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:25.850761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:25.850837 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:25.851121 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:25.851122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:25.851122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:25.851259 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:05:25.851334 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:25.851655 (+ 321us) server_negotiation.cc:299] Negotiation successful
0620 22:05:25.851729 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:05:25.851985 12972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.838370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45331 (local address 127.1.55.195:51477)
0620 22:05:25.838534 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:25.838580 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:25.839244 (+ 664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:25.839711 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:05:25.839715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:05:25.839948 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:05:25.840199 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.840205 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.843715 (+ 3510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.843716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.845005 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.845008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.845598 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.845599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.845729 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.846308 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:05:25.846317 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:05:25.848420 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:05:25.850374 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:05:25.850381 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:05:25.850383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:05:25.850659 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:05:25.850914 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:05:25.850915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:05:25.850915 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:05:25.851040 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:05:25.851341 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:05:25.851348 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:05:25.851500 (+ 152us) client_negotiation.cc:769] Sending connection context
0620 22:05:25.851615 (+ 115us) client_negotiation.cc:240] Negotiation successful
0620 22:05:25.851751 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260620 22:05:25.852600 12970 heartbeater.cc:347] Connected to a master server at 127.1.55.254:45331
I20260620 22:05:25.852684 12970 heartbeater.cc:464] Registering TS with master...
I20260620 22:05:25.852867 12970 heartbeater.cc:511] Master 127.1.55.254:45331 requested a full tablet report, sending...
I20260620 22:05:25.853248 12486 ts_manager.cc:194] Registered new tserver with Master: e567519378174591ad2ad0ac6a8bfb28 (127.1.55.195:44455)
I20260620 22:05:25.853719 12486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:51477
I20260620 22:05:25.861639 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:05:25.871048 12701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.863349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48664 (local address 127.1.55.254:45331)
0620 22:05:25.863385 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:25.863387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:25.863538 (+ 151us) server_negotiation.cc:407] Connection header received
0620 22:05:25.863644 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:25.863644 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:25.863655 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:25.863686 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:05:25.864457 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.865179 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.866284 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.866560 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.866620 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.868133 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:05:25.868134 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:05:25.868135 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:05:25.868142 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:05:25.869820 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:25.870221 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:25.870222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:25.870222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:25.870277 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:05:25.870485 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:05:25.870486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:05:25.870486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:05:25.870600 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:05:25.870683 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:25.870892 (+ 209us) server_negotiation.cc:299] Negotiation successful
0620 22:05:25.870962 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:05:25.873251 12486 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:05:25.875497 12486 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:05:25.883733 12984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.878075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:44455 (local address 127.0.0.1:38010)
0620 22:05:25.878674 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:25.878711 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:25.878897 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:25.879222 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:05:25.879225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:05:25.879227 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:05:25.879288 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.879289 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.880817 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.880818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.882121 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.882124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.883447 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.883448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.883522 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.883536 (+ 14us) client_negotiation.cc:769] Sending connection context
0620 22:05:25.883603 (+ 67us) client_negotiation.cc:240] Negotiation successful
0620 22:05:25.883663 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":92,"threads_started":1}
I20260620 22:05:25.885994 12985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.878324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38010 (local address 127.1.55.195:44455)
0620 22:05:25.878965 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:25.878969 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:25.878979 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:05:25.879015 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:25.879017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:25.879051 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:25.879130 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:05:25.879373 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.880453 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.882247 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.883279 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.883344 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.883414 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:25.885881 (+ 2467us) server_negotiation.cc:299] Negotiation successful
0620 22:05:25.885920 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":75,"threads_started":1}
I20260620 22:05:25.887006 12982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.878078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41035 (local address 127.0.0.1:33164)
0620 22:05:25.879071 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:25.879080 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:25.882090 (+ 3010us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:25.882349 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:05:25.882349 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:05:25.882351 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:05:25.882389 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.882390 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.884563 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.884564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.885723 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.885726 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.886774 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.886775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.886850 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.886853 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:05:25.886899 (+ 46us) client_negotiation.cc:240] Negotiation successful
0620 22:05:25.886935 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":981,"thread_start_us":83,"threads_started":1}
I20260620 22:05:25.887427 12987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.878493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33164 (local address 127.1.55.194:41035)
0620 22:05:25.880203 (+ 1710us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:25.880207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:25.880220 (+ 13us) server_negotiation.cc:407] Connection header received
0620 22:05:25.882207 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:25.882210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:25.882225 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:25.882286 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:05:25.882452 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.884466 (+ 2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.885839 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.886623 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.886684 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.886743 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:25.887313 (+ 570us) server_negotiation.cc:299] Negotiation successful
0620 22:05:25.887353 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1675,"thread_start_us":93,"threads_started":1}
I20260620 22:05:25.888170 12759 tablet_service.cc:1467] Processing CreateTablet for tablet dfcf649a0059469f8ec75cb197cfdf3e (DEFAULT_TABLE table=test-table [id=acae832ac86f47e8a746547d55857759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:05:25.888486 12759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfcf649a0059469f8ec75cb197cfdf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:05:25.888553 12984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.878309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41831 (local address 127.0.0.1:37284)
0620 22:05:25.884069 (+ 5760us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:25.884078 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:25.884115 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:25.884372 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:05:25.884372 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:05:25.884374 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:05:25.884399 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.884401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.886276 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.886277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.887320 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:25.887322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.888343 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.888344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:25.888405 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.888408 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:05:25.888456 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 22:05:25.888491 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5749,"thread_start_us":55,"threads_started":1}
I20260620 22:05:25.889216 12904 tablet_service.cc:1467] Processing CreateTablet for tablet dfcf649a0059469f8ec75cb197cfdf3e (DEFAULT_TABLE table=test-table [id=acae832ac86f47e8a746547d55857759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:05:25.889554 12904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfcf649a0059469f8ec75cb197cfdf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:05:25.892586 12989 tablet_bootstrap.cc:492] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Bootstrap starting.
I20260620 22:05:25.893086 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:25.878518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37284 (local address 127.1.55.193:41831)
0620 22:05:25.879011 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:25.879016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:25.884173 (+ 5157us) server_negotiation.cc:407] Connection header received
0620 22:05:25.884213 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:25.884215 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:25.884231 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:25.884304 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:05:25.884473 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.886189 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.887418 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:25.888185 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:25.888257 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:25.888310 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:25.892968 (+ 4658us) server_negotiation.cc:299] Negotiation successful
0620 22:05:25.893011 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":51,"threads_started":1}
I20260620 22:05:25.893770 12614 tablet_service.cc:1467] Processing CreateTablet for tablet dfcf649a0059469f8ec75cb197cfdf3e (DEFAULT_TABLE table=test-table [id=acae832ac86f47e8a746547d55857759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:05:25.894060 12614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfcf649a0059469f8ec75cb197cfdf3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:05:25.894999 12989 tablet_bootstrap.cc:654] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Neither blocks nor log segments found. Creating new log.
I20260620 22:05:25.895272 12989 log.cc:824] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Log is configured to *not* fsync() on all Append() calls
I20260620 22:05:25.895931 12989 tablet_bootstrap.cc:492] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: No bootstrap required, opened a new log
I20260620 22:05:25.895979 12989 ts_tablet_manager.cc:1397] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260620 22:05:25.897599 12988 tablet_bootstrap.cc:492] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Bootstrap starting.
I20260620 22:05:25.897656 12989 raft_consensus.cc:348] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:25.897807 12989 raft_consensus.cc:374] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:05:25.897840 12989 raft_consensus.cc:729] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e567519378174591ad2ad0ac6a8bfb28, State: Initialized, Role: FOLLOWER
I20260620 22:05:25.897950 12989 consensus_queue.cc:260] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:25.898193 12989 ts_tablet_manager.cc:1428] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:05:25.898197 12991 tablet_bootstrap.cc:492] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2: Bootstrap starting.
I20260620 22:05:25.898542 12988 tablet_bootstrap.cc:654] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Neither blocks nor log segments found. Creating new log.
I20260620 22:05:25.898814 12991 tablet_bootstrap.cc:654] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2: Neither blocks nor log segments found. Creating new log.
I20260620 22:05:25.898835 12988 log.cc:824] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Log is configured to *not* fsync() on all Append() calls
I20260620 22:05:25.899075 12991 log.cc:824] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2: Log is configured to *not* fsync() on all Append() calls
I20260620 22:05:25.899133 12970 heartbeater.cc:503] Master 127.1.55.254:45331 was elected leader, sending a full tablet report...
I20260620 22:05:25.899693 12991 tablet_bootstrap.cc:492] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2: No bootstrap required, opened a new log
I20260620 22:05:25.899744 12991 ts_tablet_manager.cc:1397] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:05:25.901921 12988 tablet_bootstrap.cc:492] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: No bootstrap required, opened a new log
I20260620 22:05:25.902010 12988 ts_tablet_manager.cc:1397] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260620 22:05:25.901985 12991 raft_consensus.cc:348] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:25.902125 12991 raft_consensus.cc:374] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:05:25.902170 12991 raft_consensus.cc:729] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d6eecf6b7404bc9aaee37ce6f1db3a2, State: Initialized, Role: FOLLOWER
I20260620 22:05:25.902271 12991 consensus_queue.cc:260] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:25.902498 12991 ts_tablet_manager.cc:1428] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:05:25.902537 12698 heartbeater.cc:503] Master 127.1.55.254:45331 was elected leader, sending a full tablet report...
I20260620 22:05:25.904072 12988 raft_consensus.cc:348] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:25.904191 12988 raft_consensus.cc:374] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:05:25.904211 12988 raft_consensus.cc:729] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a9861638809401ab6a26b5f009da3e2, State: Initialized, Role: FOLLOWER
I20260620 22:05:25.904321 12988 consensus_queue.cc:260] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:25.904572 12988 ts_tablet_manager.cc:1428] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:05:25.904609 12835 heartbeater.cc:503] Master 127.1.55.254:45331 was elected leader, sending a full tablet report...
Jun 20 22:05:25 dist-test-slave-xw35 krb5kdc[12010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993125, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:05:26.052887 12996 raft_consensus.cc:482] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:05:26.053030 12996 raft_consensus.cc:504] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:26.053483 12996 leader_election.cc:288] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e567519378174591ad2ad0ac6a8bfb28 (127.1.55.195:44455), 0d6eecf6b7404bc9aaee37ce6f1db3a2 (127.1.55.193:41831)
I20260620 22:05:26.057317 12838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:26.053699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:44455 (local address 127.1.55.194:56009)
0620 22:05:26.053791 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:26.053802 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:26.053842 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:26.054176 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:05:26.054177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:05:26.054179 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:05:26.054252 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:26.054254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.055186 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.055188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:26.056362 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:26.056365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.057081 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.057082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:26.057149 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:26.057152 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:05:26.057194 (+ 42us) client_negotiation.cc:240] Negotiation successful
0620 22:05:26.057227 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260620 22:05:26.057550 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:26.054130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:39677 (local address 127.1.55.193:41831)
0620 22:05:26.054180 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:26.054182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:26.054190 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:05:26.054215 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:26.054216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:26.054227 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:26.054277 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:05:26.054491 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.055199 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.056557 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.057123 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.057186 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:26.057194 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:26.057404 (+ 210us) server_negotiation.cc:299] Negotiation successful
0620 22:05:26.057449 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260620 22:05:26.057745 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:26.053714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41831 (local address 127.1.55.194:39677)
0620 22:05:26.053962 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:26.053973 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:26.054028 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:26.054326 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:05:26.054327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:05:26.054329 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:05:26.054407 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:26.054409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.055315 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.055316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:26.056456 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:05:26.056459 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.057253 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.057253 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:05:26.057321 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:26.057325 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:05:26.057626 (+ 301us) client_negotiation.cc:240] Negotiation successful
0620 22:05:26.057664 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":72,"threads_started":1}
I20260620 22:05:26.057966 12985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:26.053918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:56009 (local address 127.1.55.195:44455)
0620 22:05:26.053958 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:26.053960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:26.053967 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:05:26.053992 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:26.053992 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:26.054001 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:26.054051 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:05:26.054334 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.055075 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.056481 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.056986 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.057046 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:26.057054 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:26.057875 (+ 821us) server_negotiation.cc:299] Negotiation successful
0620 22:05:26.057909 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:05:26.058200 12924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfcf649a0059469f8ec75cb197cfdf3e" candidate_uuid: "6a9861638809401ab6a26b5f009da3e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e567519378174591ad2ad0ac6a8bfb28" is_pre_election: true
I20260620 22:05:26.058338 12924 raft_consensus.cc:2454] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9861638809401ab6a26b5f009da3e2 in term 0.
I20260620 22:05:26.058552 12631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfcf649a0059469f8ec75cb197cfdf3e" candidate_uuid: "6a9861638809401ab6a26b5f009da3e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" is_pre_election: true
I20260620 22:05:26.058565 12724 leader_election.cc:302] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a9861638809401ab6a26b5f009da3e2, e567519378174591ad2ad0ac6a8bfb28; no voters:
I20260620 22:05:26.058667 12631 raft_consensus.cc:2454] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a9861638809401ab6a26b5f009da3e2 in term 0.
I20260620 22:05:26.058907 12996 raft_consensus.cc:2781] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:05:26.058977 12996 raft_consensus.cc:482] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:05:26.058997 12996 raft_consensus.cc:3037] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:05:26.059769 12996 raft_consensus.cc:504] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:26.059880 12996 leader_election.cc:288] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [CANDIDATE]: Term 1 election: Requested vote from peers e567519378174591ad2ad0ac6a8bfb28 (127.1.55.195:44455), 0d6eecf6b7404bc9aaee37ce6f1db3a2 (127.1.55.193:41831)
I20260620 22:05:26.060076 12631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfcf649a0059469f8ec75cb197cfdf3e" candidate_uuid: "6a9861638809401ab6a26b5f009da3e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2"
I20260620 22:05:26.060091 12924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfcf649a0059469f8ec75cb197cfdf3e" candidate_uuid: "6a9861638809401ab6a26b5f009da3e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e567519378174591ad2ad0ac6a8bfb28"
I20260620 22:05:26.060137 12631 raft_consensus.cc:3037] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:05:26.060168 12924 raft_consensus.cc:3037] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:05:26.060871 12631 raft_consensus.cc:2454] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a9861638809401ab6a26b5f009da3e2 in term 1.
I20260620 22:05:26.060966 12924 raft_consensus.cc:2454] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a9861638809401ab6a26b5f009da3e2 in term 1.
I20260620 22:05:26.061025 12725 leader_election.cc:302] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d6eecf6b7404bc9aaee37ce6f1db3a2, 6a9861638809401ab6a26b5f009da3e2; no voters:
I20260620 22:05:26.061297 12996 raft_consensus.cc:2781] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:05:26.061416 12996 raft_consensus.cc:686] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 1 LEADER]: Becoming Leader. State: Replica: 6a9861638809401ab6a26b5f009da3e2, State: Running, Role: LEADER
I20260620 22:05:26.061511 12996 consensus_queue.cc:237] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } }
I20260620 22:05:26.062309 12486 catalog_manager.cc:5495] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a9861638809401ab6a26b5f009da3e2 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "6a9861638809401ab6a26b5f009da3e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a9861638809401ab6a26b5f009da3e2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 } health_report { overall_health: UNKNOWN } } }
W20260620 22:05:26.096429 12971 tablet.cc:2369] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:05:26.099924 12836 tablet.cc:2369] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:05:26.110991 12699 tablet.cc:2369] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:05:26.111455 12987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:26.108308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33168 (local address 127.1.55.194:41035)
0620 22:05:26.108446 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0620 22:05:26.108449 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:05:26.108456 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:05:26.108485 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:05:26.108486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:05:26.108505 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:05:26.108566 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:05:26.108778 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.109386 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.110505 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:05:26.110784 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:05:26.110853 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:05:26.111054 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:05:26.111181 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:05:26.111263 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0620 22:05:26.111366 (+ 103us) server_negotiation.cc:299] Negotiation successful
0620 22:05:26.111387 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260620 22:05:26.113306 12631 raft_consensus.cc:1261] T dfcf649a0059469f8ec75cb197cfdf3e P 0d6eecf6b7404bc9aaee37ce6f1db3a2 [term 1 FOLLOWER]: Refusing update from remote peer 6a9861638809401ab6a26b5f009da3e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:05:26.113304 12924 raft_consensus.cc:1261] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 1 FOLLOWER]: Refusing update from remote peer 6a9861638809401ab6a26b5f009da3e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:05:26.113673 12996 consensus_queue.cc:1035] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e567519378174591ad2ad0ac6a8bfb28" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:05:26.113878 12998 consensus_queue.cc:1035] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d6eecf6b7404bc9aaee37ce6f1db3a2" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 41831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:05:26.117223 13004 mvcc.cc:205] Tried to move back new op lower bound from 7299043844557627392 to 7299043844348473344. Current Snapshot: MvccSnapshot[applied={T|T < 7299043844557627392}]
I20260620 22:05:26.118499 12485 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:05:26.118582 12485 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:05:26.119302 12485 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9710c00c06ce40b893e9417a352676e2: Sending DeleteTablet for 3 replicas of tablet dfcf649a0059469f8ec75cb197cfdf3e
I20260620 22:05:26.119716 12904 tablet_service.cc:1514] Processing DeleteTablet for tablet dfcf649a0059469f8ec75cb197cfdf3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:05:26 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:38010
I20260620 22:05:26.119884 12614 tablet_service.cc:1514] Processing DeleteTablet for tablet dfcf649a0059469f8ec75cb197cfdf3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:05:26 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:37284
I20260620 22:05:26.120185 12759 tablet_service.cc:1514] Processing DeleteTablet for tablet dfcf649a0059469f8ec75cb197cfdf3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:05:26 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:33164
I20260620 22:05:26.120764 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 12567
I20260620 22:05:26.123903 13011 tablet_replica.cc:330] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: stopping tablet replica
I20260620 22:05:26.124047 13009 tablet_replica.cc:330] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: stopping tablet replica
I20260620 22:05:26.124208 13009 raft_consensus.cc:2229] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:05:26.124346 13011 raft_consensus.cc:2229] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:05:26.124480 13009 pending_rounds.cc:62] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Trying to abort 2 pending ops.
I20260620 22:05:26.124574 13011 raft_consensus.cc:2258] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:05:26.124709 13009 pending_rounds.cc:68] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7299043844557627392 op_type: WRITE_OP write_request { tablet_id: "dfcf649a0059469f8ec75cb197cfdf3e" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\322\237\334\321\006\"8\n\ntest-admin\022*\n acae832ac86f47e8a746547d55857759\020\001\030\001 \001(\001" signature: "<redacted>""I\236\352\236\256!\000swXw{4\231\304\311\201\331-\335\222)\305\276\022\021\375T\216\021\224\370\274f\265z\000Y;\317\331b\027\262\235\200!\222\203\370b)\242\250\030Ws\3215(\245\336<\251" signing_key_seq_num: 0 } } request_id { client_id: "12bd1ce02ed54c1d9c11f7fbfbcb7e57" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260620 22:05:26.125303 13011 ts_tablet_manager.cc:1905] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:05:26.125449 13009 pending_rounds.cc:68] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7299043844348473344 op_type: NO_OP noop_request { }
I20260620 22:05:26.125605 13009 raft_consensus.cc:2866] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 22:05:26.125671 13009 raft_consensus.cc:2258] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:05:26.127274 13011 ts_tablet_manager.cc:1918] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:05:26.127386 13011 log.cc:1196] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/dfcf649a0059469f8ec75cb197cfdf3e
I20260620 22:05:26.127720 13011 ts_tablet_manager.cc:1939] T dfcf649a0059469f8ec75cb197cfdf3e P 6a9861638809401ab6a26b5f009da3e2: Deleting consensus metadata
W20260620 22:05:26.131428 13003 consensus_queue.cc:1159] T dfcf649a0059469f8ec75cb197cfdf3e P e567519378174591ad2ad0ac6a8bfb28 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e567519378174591ad2ad0ac6a8bfb28" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
W20260620 22:05:26.131471 12725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:41831 (error 108)
I20260620 22:05:26.132113 12471 catalog_manager.cc:4841] TS 6a9861638809401ab6a26b5f009da3e2 (127.1.55.194:41035): tablet dfcf649a0059469f8ec75cb197cfdf3e (table test-table [id=acae832ac86f47e8a746547d55857759]) successfully deleted
W20260620 22:05:26.132593 12473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:41831 (error 108)
W20260620 22:05:26.132895 12470 connection.cc:535] server connection from 127.1.55.193:48903 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 22:05:26.133119 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:05:26.132467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41831 (local address 127.1.55.194:48833)
0620 22:05:26.132509 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:26.132521 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:05:26.132567 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:05:26.133085 (+ 518us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:41831: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":21}
I20260620 22:05:26.133934 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 12704
I20260620 22:05:26.137887 12984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:05:26.137791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:41831 (local address 127.0.0.1:37300)
0620 22:05:26.137830 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0620 22:05:26.137860 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:41831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260620 22:05:26.138025 12473 catalog_manager.cc:4584] TS 0d6eecf6b7404bc9aaee37ce6f1db3a2 (127.1.55.193:41831): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dfcf649a0059469f8ec75cb197cfdf3e: Network error: Client connection negotiation failed: client connection to 127.1.55.193:41831: connect: Connection refused (error 111)
I20260620 22:05:26.140074 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 12841
I20260620 22:05:26.147334 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 12454
I20260620 22:05:26.151895 1247 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260620 22:05:26.485975 1247 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260620 22:05:26.486060 1247 mini_ranger.cc:66] Stopping Ranger...
I20260620 22:05:26.830359 1247 mini_ranger.cc:68] Stopped Ranger
2026-06-20 22:05:26.830 UTC [12040] LOG: received smart shutdown request
2026-06-20 22:05:26.833 UTC [12040] LOG: background worker "logical replication launcher" (PID 12049) exited with exit code 1
2026-06-20 22:05:26.833 UTC [12044] LOG: shutting down
2026-06-20 22:05:26.967 UTC [12040] LOG: database system is shut down
2026-06-20T22:05:26Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (41778 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:05:27 dist-test-slave-xw35 krb5kdc[13022](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:05:27 dist-test-slave-xw35 krb5kdc[13022](info): set up 2 sockets
Jun 20 22:05:27 dist-test-slave-xw35 krb5kdc[13022](info): commencing operation
krb5kdc: starting...
W20260620 22:05:28.057327 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.967s user 0.003s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:05:28 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:05:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:05:28Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.55.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.55.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/rangeradmin_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/rangeradmin_127.1.55.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.55.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.55.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/rangerlookup_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/rangerlookup_127.1.55.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.55.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.55.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/HTTP_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/HTTP_127.1.55.212@KRBTEST.COM.keytab.
I20260620 22:05:28.203311 1247 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskKulyh2/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/postgres -l logfile start
2026-06-20 22:05:30.375 UTC [13052] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-20 22:05:30.375 UTC [13052] LOG: listening on IPv4 address "127.1.55.212", port 58171
2026-06-20 22:05:30.378 UTC [13052] LOG: listening on Unix socket "/tmp/.s.PGSQL.58171"
2026-06-20 22:05:30.398 UTC [13055] LOG: database system was shut down at 2026-06-20 22:05:29 UTC
2026-06-20 22:05:30.401 UTC [13052] LOG: database system is ready to accept connections
I20260620 22:05:31.325074 1247 mini_postgres.cc:96] Postgres bound to 58171
2026-06-20 22:05:31.330 UTC [13063] FATAL: database "slave" does not exist
127.1.55.212:58171 - accepting connections
I20260620 22:05:31.331354 1247 mini_ranger.cc:161] Starting Ranger...
I20260620 22:05:31.344458 1247 mini_ranger.cc:84] Created miniranger Postgres user
I20260620 22:05:31.729605 1247 mini_ranger.cc:87] Created ranger Postgres database
I20260620 22:05:31.729677 1247 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-admin
2026-06-20 22:05:31,984 [I] DB FLAVOR :POSTGRES
2026-06-20 22:05:31,985 [I] --------- Verifying Ranger DB connection ---------
2026-06-20 22:05:31,985 [I] Checking connection..
2026-06-20 22:05:31,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-20 22:05:32,226 [I] Checking connection passed.
2026-06-20 22:05:32,226 [I] --------- Verifying version history table ---------
2026-06-20 22:05:32,226 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 22:05:32,432 [I] Table x_db_version_h does not exist in database ranger
2026-06-20 22:05:32,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 22:05:32,667 [I] Table x_db_version_h does not exist in database ranger
2026-06-20 22:05:32,667 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-20 22:05:32,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-20 22:05:32.898 UTC [13127] WARNING: there is no transaction in progress
2026-06-20 22:05:32,903 [I] create_dbversion_catalog.sql file imported successfully
2026-06-20 22:05:32,903 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-20 22:05:33,144 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-20 22:05:33,145 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-20 22:05:33,145 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-20 22:05:33,382 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-20 22:05:33,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-xw35.c.gcp-upstream.internal','N') ;"
2026-06-20 22:05:33,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-20 22:05:34,092 [I] Table x_portal_user does not exist in database ranger
2026-06-20 22:05:34,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-20 22:05:34,301 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-20 22:05:34,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-20 22:05:34,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-20 22:05:34,744 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-20 22:05:34,744 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-20 22:05:35.591 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.606 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.619 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.632 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.649 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.663 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.710 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.716 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.728 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.737 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.746 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.757 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.766 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.771 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.775 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:35.780 UTC [13235] WARNING: there is no transaction in progress
2026-06-20 22:05:36,307 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-20 22:05:36,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-20 22:05:36,535 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-20 22:05:36,535 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-20 22:05:36,760 [I] Table x_portal_user already exists in database 'ranger'
2026-06-20 22:05:36,760 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-20 22:05:36,993 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-20 22:05:36,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-20 22:05:37,212 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-20 22:05:37,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-xw35.c.gcp-upstream.internal';"
2026-06-20 22:05:37,623 [I] CORE_DB_SCHEMA import status has been updated
2026-06-20 22:05:37,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-20 22:05:37,854 [I] DB_PATCHES have already been applied
I20260620 22:05:37.859740 1247 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-admin:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskKulyh2/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260620 22:05:37.859818 1247 mini_ranger.cc:193] Using host: 127.1.55.212
I20260620 22:05:37.862692 1247 mini_ranger.cc:227] Ranger admin URL: http://127.1.55.212:33343
Jun 20, 2026 10:05:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 20, 2026 10:05:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 20, 2026 10:05:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-admin/ews/webapp
Jun 20, 2026 10:05:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 20, 2026 10:05:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 20, 2026 10:05:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-admin/ews/webapp].
Jun 20, 2026 10:05:38 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260620 22:05:38.916400 1247 mini_ranger.cc:160] Time spent starting Ranger: real 7.585s user 0.002s sys 0.005s
Jun 20, 2026 10:05:56 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 20, 2026 10:05:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Jun 20, 2026 10:05:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 20, 2026 10:05:56 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 20, 2026 10:05:57 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260620 22:05:58.184295 1247 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.55.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.55.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/rangerkms_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.55.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/rangerkms_127.1.55.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.55.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.55.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.55.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/HTTP_127.1.55.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.55.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/HTTP_127.1.55.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 20 22:05:58 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993158, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260620 22:05:58.256954 1247 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260620 22:05:58.265259 1247 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260620 22:05:59.032958 1247 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260620 22:05:59.033021 1247 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms
I20260620 22:05:59.033033 1247 mini_ranger_kms.cc:227] Using postgres at 127.1.55.212:58171
2026-06-20 22:05:59,186 [I] DB FLAVOR :POSTGRES
2026-06-20 22:05:59,186 [I] --------- Verifying Ranger DB connection ---------
2026-06-20 22:05:59,186 [I] Checking connection
2026-06-20 22:05:59,186 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-20 22:05:59,421 [I] connection success
2026-06-20 22:05:59,421 [I] --------- Verifying Ranger DB tables ---------
2026-06-20 22:05:59,422 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-20 22:05:59,422 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-20 22:05:59,640 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-20 22:05:59,641 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-20 22:05:59,641 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-20 22:05:59,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.55.212:58171/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-20 22:05:59,881 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260620 22:06:00.305627 1247 mini_ranger_kms.cc:310] Created kms service
I20260620 22:06:00.454967 1247 mini_ranger_kms.cc:326] Created kudu user
I20260620 22:06:00.492518 1247 mini_ranger_kms.cc:343] Created rangerkms user
Jun 20 22:06:00 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993158, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:00.850127 1247 mini_ranger_kms.cc:384] Added ranger policy
I20260620 22:06:00.850257 1247 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms:/tmp/dist-test-taskKulyh2/build/release/bin/postgresql.jar:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskKulyh2/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260620 22:06:00.850278 1247 mini_ranger_kms.cc:240] Using host: 127.1.55.212
I20260620 22:06:00.853583 1247 mini_ranger_kms.cc:276] Ranger KMS PID: 13415
I20260620 22:06:00.853662 1247 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.55.212:43087
Jun 20, 2026 10:06:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 20, 2026 10:06:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 20, 2026 10:06:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 20, 2026 10:06:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 20, 2026 10:06:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-kms/ews/webapp].
Jun 20, 2026 10:06:02 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260620 22:06:02.960251 1247 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 4.703s user 0.004s sys 0.134s
I20260620 22:06:02.960350 1247 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260620 22:06:02.960397 1247 mini_ranger_kms.cc:401] 127.1.55.212:43087/kms/v1/keys
Jun 20 22:06:03 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781993163, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.55.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 20 22:06:03 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993163, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.55.212@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
Jun 20 22:06:03 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993163, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.55.212@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
Jun 20 22:06:05 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:06:05.903936 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46797
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:46797
--ranger_config_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:43087/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:05.995138 13466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:05.995364 13466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:05.995401 13466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:05.996455 13466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:05.996515 13466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:05.996536 13466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:05.996562 13466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:05.996590 13466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:05.998015 13466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.55.212:43087/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:46797
--ranger_config_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:05.998266 13466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:05.998497 13466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:06.003949 13474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:06.003939 13472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:06.004184 13466 server_base.cc:1034] running on GCE node
W20260620 22:06:06.004066 13471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:06.004470 13466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:06.004745 13466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:06.005898 13466 hybrid_clock.cc:648] HybridClock initialized: now 1781993166005879 us; error 38 us; skew 500 ppm
Jun 20 22:06:06 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993166, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:06.008374 13466 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:06.008838 13466 webserver.cc:460] Webserver started at http://127.1.55.254:40057/ using document root <none> and password file <none>
I20260620 22:06:06.009061 13466 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:06.009121 13466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:06.009265 13466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 22:06:06 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993166, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:06.065033 13466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "b5785051528c4d2c9d3638f1f52c7e4a"
format_stamp: "Formatted at 2026-06-20 22:06:06 on dist-test-slave-xw35"
server_key: "a7ccfa5ac63a71961516107eac5b1efe"
server_key_iv: "8260fec11bf400fac47e27703ad9b976"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:06.065413 13466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "b5785051528c4d2c9d3638f1f52c7e4a"
format_stamp: "Formatted at 2026-06-20 22:06:06 on dist-test-slave-xw35"
server_key: "a7ccfa5ac63a71961516107eac5b1efe"
server_key_iv: "8260fec11bf400fac47e27703ad9b976"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:06.066787 13466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:06.079694 13481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:06.079859 13466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:06.079972 13466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "b5785051528c4d2c9d3638f1f52c7e4a"
format_stamp: "Formatted at 2026-06-20 22:06:06 on dist-test-slave-xw35"
server_key: "a7ccfa5ac63a71961516107eac5b1efe"
server_key_iv: "8260fec11bf400fac47e27703ad9b976"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:06.080063 13466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:06.097853 13466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:06.099824 13466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:06.099964 13466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:06.104038 13466 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:46797
I20260620 22:06:06.104076 13533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:46797 every 8 connection(s)
I20260620 22:06:06.104375 13466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:06.104928 13534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:06.107076 13534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Bootstrap starting.
I20260620 22:06:06.107617 13534 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:06.107936 13534 log.cc:824] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:06.108570 13534 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: No bootstrap required, opened a new log
I20260620 22:06:06.109553 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 13466
I20260620 22:06:06.109627 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:06:06.109891 1247 external_mini_cluster.cc:1428] Setting key 8de6d070ec105bbc3f3c3a54867134d4
I20260620 22:06:06.111297 13534 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } }
I20260620 22:06:06.111521 13534 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:06.111703 13534 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5785051528c4d2c9d3638f1f52c7e4a, State: Initialized, Role: FOLLOWER
I20260620 22:06:06.111874 13534 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } }
I20260620 22:06:06.111963 13534 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:06:06.112002 13534 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:06:06.112051 13534 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:06.112757 13534 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } }
I20260620 22:06:06.112851 13534 leader_election.cc:302] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5785051528c4d2c9d3638f1f52c7e4a; no voters:
I20260620 22:06:06.112984 13534 leader_election.cc:288] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:06:06.113149 13540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:06.113227 13534 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:06.113392 13540 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 1 LEADER]: Becoming Leader. State: Replica: b5785051528c4d2c9d3638f1f52c7e4a, State: Running, Role: LEADER
I20260620 22:06:06.113586 13540 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } }
I20260620 22:06:06.114773 13541 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5785051528c4d2c9d3638f1f52c7e4a. Latest consensus state: current_term: 1 leader_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } } }
I20260620 22:06:06.114802 13539 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } } }
I20260620 22:06:06.114871 13541 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:06.114876 13539 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:06.115069 13554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:06.115270 13534 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260620 22:06:06.115506 13554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 20 22:06:06 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:06.120631 13554 catalog_manager.cc:1347] Generated new cluster ID: 489c341a4d9a44d6875cf411a7c334a8
I20260620 22:06:06.120750 13554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:06:06.124303 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:06.110414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53128 (local address 127.1.55.254:46797)
0620 22:06:06.110593 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:06.110601 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:06.110847 (+ 246us) server_negotiation.cc:407] Connection header received
0620 22:06:06.111286 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:06.111306 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:06.111377 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:06.111517 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:06.112447 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:06.113860 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:06.114986 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:06.115610 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:06.115709 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:06.118960 (+ 3251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:06.119007 (+ 47us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:06.119007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:06.119034 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:06.122236 (+ 3202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:06.122596 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:06.122599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:06.122599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:06.123032 (+ 433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:06.123236 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:06.123237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:06.123238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:06.123556 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:06.123772 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:06.123841 (+ 69us) server_negotiation.cc:299] Negotiation successful
0620 22:06:06.124103 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260620 22:06:06.133044 13554 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:06:06.133550 13554 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:06:06.136505 13554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Generated new TSK 0
I20260620 22:06:06.136662 13554 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:06:06.843605 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:43087/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46797
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:06.953229 13579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:06.953498 13579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:06.953532 13579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:06.955092 13579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:06.955143 13579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:06.955189 13579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:06:06.957228 13579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.55.212:43087/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:06.957434 13579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:06.957674 13579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:06.962774 13587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:06.962774 13584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:06.963007 13585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:06.963029 13579 server_base.cc:1034] running on GCE node
I20260620 22:06:06.963409 13579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:06.963680 13579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:06.964845 13579 hybrid_clock.cc:648] HybridClock initialized: now 1781993166964820 us; error 37 us; skew 500 ppm
Jun 20 22:06:06 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993166, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:06.967541 13579 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:06:06.967952 13579 webserver.cc:460] Webserver started at http://127.1.55.193:43089/ using document root <none> and password file <none>
I20260620 22:06:06.968165 13579 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:06.968250 13579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:06.968477 13579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 22:06:06 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993166, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:06.980641 13579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "69dfd73592c94f378b1369db0c3cb134"
format_stamp: "Formatted at 2026-06-20 22:06:06 on dist-test-slave-xw35"
server_key: "a99a596b90b5842c4d447884addddd7a"
server_key_iv: "7901ffb47658a1ae527b52ff38a926c7"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:06.981074 13579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "69dfd73592c94f378b1369db0c3cb134"
format_stamp: "Formatted at 2026-06-20 22:06:06 on dist-test-slave-xw35"
server_key: "a99a596b90b5842c4d447884addddd7a"
server_key_iv: "7901ffb47658a1ae527b52ff38a926c7"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:06.982896 13579 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260620 22:06:06.994868 13596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:06.995054 13579 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:06.995162 13579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "69dfd73592c94f378b1369db0c3cb134"
format_stamp: "Formatted at 2026-06-20 22:06:06 on dist-test-slave-xw35"
server_key: "a99a596b90b5842c4d447884addddd7a"
server_key_iv: "7901ffb47658a1ae527b52ff38a926c7"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:06.995265 13579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:07.007894 13579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:07.010185 13579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:07.010316 13579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:07.010551 13579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:07.010870 13579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:07.010919 13579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.010957 13579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:07.010986 13579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.017830 13579 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:37705
I20260620 22:06:07.018323 13579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:06:07.018959 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 13579
I20260620 22:06:07.019068 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:06:07.019277 1247 external_mini_cluster.cc:1428] Setting key 83b07341ba9fae06676e52ae87f7f750
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
I20260620 22:06:07.034121 13709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:37705 every 8 connection(s)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993166, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:07.050652 13713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:07.035238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:53675 (local address 127.1.55.254:46797)
0620 22:06:07.036988 (+ 1750us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:07.036990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:07.036997 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:06:07.037022 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:07.037022 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:07.037034 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:07.037104 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:07.037962 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.038820 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.040292 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.040577 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.040651 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:07.046428 (+ 5777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:07.046429 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:07.046429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:07.046436 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:07.048328 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:07.049134 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:07.049135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:07.049135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:07.049201 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:07.049603 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:07.049604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:07.049604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:07.049804 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:07.049867 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:07.050476 (+ 609us) server_negotiation.cc:299] Negotiation successful
0620 22:06:07.050556 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1721,"thread_start_us":66,"threads_started":1}
I20260620 22:06:07.051263 13714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:07.035225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46797 (local address 127.1.55.193:53675)
0620 22:06:07.036078 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:07.036128 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:07.036799 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:07.037232 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:07.037237 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:07.037466 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:07.037849 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:07.037856 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.038938 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.038938 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:07.040188 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:07.040191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.040743 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.040744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:07.040885 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:07.041457 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:07.041467 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:07.046322 (+ 4855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:07.048728 (+ 2406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:07.048735 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:07.048737 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:07.049020 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:07.049335 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:07.049336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:07.049336 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:07.049502 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:07.049915 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:07.049921 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:07.050112 (+ 191us) client_negotiation.cc:769] Sending connection context
0620 22:06:07.050862 (+ 750us) client_negotiation.cc:240] Negotiation successful
0620 22:06:07.051012 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"thread_start_us":101,"threads_started":1}
I20260620 22:06:07.051983 13710 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46797
I20260620 22:06:07.052063 13710 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:07.052224 13710 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:07.052784 13498 ts_manager.cc:194] Registered new tserver with Master: 69dfd73592c94f378b1369db0c3cb134 (127.1.55.193:37705)
I20260620 22:06:07.053630 13498 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:53675
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:06:07.056756 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:43087/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46797
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:07.173044 13716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:07.173393 13716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:07.173480 13716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:07.175377 13716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:07.175484 13716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:07.175557 13716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:06:07.177578 13716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.55.212:43087/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:07.178067 13716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:07.178407 13716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:07.184500 13726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:07.185093 13716 server_base.cc:1034] running on GCE node
W20260620 22:06:07.186712 13724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:07.186877 13723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:07.187103 13716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:07.187327 13716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:07.189577 13716 hybrid_clock.cc:648] HybridClock initialized: now 1781993167189555 us; error 34 us; skew 500 ppm
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:07.192651 13716 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:06:07.193137 13716 webserver.cc:460] Webserver started at http://127.1.55.194:34877/ using document root <none> and password file <none>
I20260620 22:06:07.193377 13716 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:07.193432 13716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:07.193594 13716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:07.206859 13716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "63913ddab2b04336b901dbe1e4c44d10"
format_stamp: "Formatted at 2026-06-20 22:06:07 on dist-test-slave-xw35"
server_key: "ec5ee81ac79f4ade470bd7663d68e878"
server_key_iv: "f383c40cae26d3625866717f1f0e18a2"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:07.207335 13716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "63913ddab2b04336b901dbe1e4c44d10"
format_stamp: "Formatted at 2026-06-20 22:06:07 on dist-test-slave-xw35"
server_key: "ec5ee81ac79f4ade470bd7663d68e878"
server_key_iv: "f383c40cae26d3625866717f1f0e18a2"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:07.213814 13716 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260620 22:06:07.224056 13733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.224233 13716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:07.224318 13716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "63913ddab2b04336b901dbe1e4c44d10"
format_stamp: "Formatted at 2026-06-20 22:06:07 on dist-test-slave-xw35"
server_key: "ec5ee81ac79f4ade470bd7663d68e878"
server_key_iv: "f383c40cae26d3625866717f1f0e18a2"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:07.224383 13716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:07.251453 13716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:07.253746 13716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:07.253858 13716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:07.254045 13716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:07.254339 13716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:07.254376 13716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.254401 13716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:07.254424 13716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.261011 13716 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:43847
I20260620 22:06:07.261158 13846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:43847 every 8 connection(s)
I20260620 22:06:07.261374 13716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:06:07.262921 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 13716
I20260620 22:06:07.263015 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:06:07.263176 1247 external_mini_cluster.cc:1428] Setting key c674c230edb560f46d21fd4c1742c252
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:07.283452 13713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:07.262190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:41321 (local address 127.1.55.254:46797)
0620 22:06:07.262235 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:07.262237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:07.272667 (+ 10430us) server_negotiation.cc:407] Connection header received
0620 22:06:07.273427 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:07.273428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:07.273442 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:07.273491 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:07.274287 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.275026 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.277637 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.277901 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.277937 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:07.280344 (+ 2407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:07.280345 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:07.280346 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:07.280353 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:07.281940 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:07.282392 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:07.282393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:07.282393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:07.282447 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:07.282714 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:07.282715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:07.282715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:07.282836 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:07.282896 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:07.283248 (+ 352us) server_negotiation.cc:299] Negotiation successful
0620 22:06:07.283350 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:06:07.284158 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:07.262164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46797 (local address 127.1.55.194:41321)
0620 22:06:07.272548 (+ 10384us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:07.272588 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:07.273185 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:07.273665 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:07.273669 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:07.273877 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:07.274179 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:07.274185 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.276423 (+ 2238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.276423 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:07.277551 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:07.277553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.278019 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.278020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:07.278152 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:07.278699 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:07.278709 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:07.280217 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:07.282027 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:07.282033 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:07.282035 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:07.282302 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:07.282523 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:07.282524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:07.282524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:07.282640 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:07.282926 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:07.282931 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:07.283113 (+ 182us) client_negotiation.cc:769] Sending connection context
0620 22:06:07.283747 (+ 634us) client_negotiation.cc:240] Negotiation successful
0620 22:06:07.283905 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10344,"thread_start_us":76,"threads_started":1}
I20260620 22:06:07.284893 13847 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46797
I20260620 22:06:07.284976 13847 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:07.285137 13847 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:07.285543 13498 ts_manager.cc:194] Registered new tserver with Master: 63913ddab2b04336b901dbe1e4c44d10 (127.1.55.194:43847)
I20260620 22:06:07.286001 13498 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:41321
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:06:07.293929 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:43087/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46797
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:07.410238 13853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:07.410548 13853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:07.410629 13853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:07.412177 13853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:07.412281 13853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:07.412362 13853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:06:07.414414 13853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.55.212:43087/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:07.414868 13853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:07.415184 13853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:07.421346 13858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:07.421705 13861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:07.422330 13859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:07.422456 13853 server_base.cc:1034] running on GCE node
I20260620 22:06:07.422619 13853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:07.422828 13853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:07.423982 13853 hybrid_clock.cc:648] HybridClock initialized: now 1781993167423964 us; error 29 us; skew 500 ppm
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:07.427023 13853 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:06:07.427434 13853 webserver.cc:460] Webserver started at http://127.1.55.195:40917/ using document root <none> and password file <none>
I20260620 22:06:07.427692 13853 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:07.427743 13853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:07.427858 13853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:07.439673 13853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "2cf6da09cc6f47138215eff2a2778ed2"
format_stamp: "Formatted at 2026-06-20 22:06:07 on dist-test-slave-xw35"
server_key: "760dda7820270a441f105733cd21dd2b"
server_key_iv: "7ee36c7eb4637a5fbfe4197573d14c9b"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:07.440016 13853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "2cf6da09cc6f47138215eff2a2778ed2"
format_stamp: "Formatted at 2026-06-20 22:06:07 on dist-test-slave-xw35"
server_key: "760dda7820270a441f105733cd21dd2b"
server_key_iv: "7ee36c7eb4637a5fbfe4197573d14c9b"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:07.445809 13853 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.001s
I20260620 22:06:07.456956 13868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.457605 13853 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260620 22:06:07.457762 13853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "2cf6da09cc6f47138215eff2a2778ed2"
format_stamp: "Formatted at 2026-06-20 22:06:07 on dist-test-slave-xw35"
server_key: "760dda7820270a441f105733cd21dd2b"
server_key_iv: "7ee36c7eb4637a5fbfe4197573d14c9b"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:07.457914 13853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:07.466929 13853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:07.468912 13853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:07.469058 13853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:07.469308 13853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:07.469651 13853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:07.469702 13853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.469730 13853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:07.469748 13853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.475845 13853 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:35303
I20260620 22:06:07.476183 13853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:06:07.481834 13981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:35303 every 8 connection(s)
I20260620 22:06:07.482884 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 13853
I20260620 22:06:07.482982 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:06:07.483155 1247 external_mini_cluster.cc:1428] Setting key 5c27f0520a0d206e353a7d19e70bf701
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:07.496102 13713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:07.482654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:36663 (local address 127.1.55.254:46797)
0620 22:06:07.482735 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:07.482737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:07.486711 (+ 3974us) server_negotiation.cc:407] Connection header received
0620 22:06:07.487361 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:07.487362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:07.487373 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:07.487402 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:07.488204 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.488976 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.490360 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.490632 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.490670 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:07.493027 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:07.493028 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:07.493029 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:07.493035 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:07.494668 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:07.495171 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:07.495172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:07.495172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:07.495235 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:07.495477 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:07.495478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:07.495479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:07.495591 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:07.495628 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:07.495944 (+ 316us) server_negotiation.cc:299] Negotiation successful
0620 22:06:07.496015 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:06:07.496770 13984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:07.482420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46797 (local address 127.1.55.195:36663)
0620 22:06:07.486590 (+ 4170us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:07.486633 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:07.487246 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:07.487568 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:07.487572 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:07.487832 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:07.488084 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:07.488090 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.489084 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.489085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:07.490267 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:07.490270 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.490761 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.490762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:07.490879 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:07.491387 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:07.491396 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:07.492909 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:07.494841 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:07.494846 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:07.494848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:07.495092 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:07.495301 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:07.495302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:07.495302 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:07.495411 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:07.495669 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:07.495675 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:07.495807 (+ 132us) client_negotiation.cc:769] Sending connection context
0620 22:06:07.496405 (+ 598us) client_negotiation.cc:240] Negotiation successful
0620 22:06:07.496565 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4125,"thread_start_us":70,"threads_started":1}
I20260620 22:06:07.497409 13982 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46797
I20260620 22:06:07.497537 13982 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:07.497707 13982 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:07.498142 13498 ts_manager.cc:194] Registered new tserver with Master: 2cf6da09cc6f47138215eff2a2778ed2 (127.1.55.195:35303)
I20260620 22:06:07.498580 13498 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:36663
I20260620 22:06:07.505343 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:06:07.506045 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 13579
I20260620 22:06:07.511144 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 13716
I20260620 22:06:07.516619 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 13853
I20260620 22:06:07.522368 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 13466
I20260620 22:06:07.529052 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46797
--webserver_interface=127.1.55.254
--webserver_port=40057
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:46797
--ranger_config_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:43087/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.55.212:43087/kms with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:07.604677 13985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:07.604846 13985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:07.604867 13985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:07.606007 13985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:07.606042 13985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:07.606055 13985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:07.606066 13985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:07.606110 13985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:07.607421 13985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.55.212:43087/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:46797
--ranger_config_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=40057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:07.607637 13985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:07.607906 13985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:07.612353 13993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:07.612388 13991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:07.612354 13990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:07.612470 13985 server_base.cc:1034] running on GCE node
I20260620 22:06:07.612919 13985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:07.613188 13985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:07.614347 13985 hybrid_clock.cc:648] HybridClock initialized: now 1781993167614341 us; error 44 us; skew 500 ppm
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:07.616604 13985 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:07.616976 13985 webserver.cc:460] Webserver started at http://127.1.55.254:40057/ using document root <none> and password file <none>
I20260620 22:06:07.617237 13985 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:07.617285 13985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:07.696702 13985 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:07.697432 14001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.697623 13985 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:07.697716 13985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "b5785051528c4d2c9d3638f1f52c7e4a"
format_stamp: "Formatted at 2026-06-20 22:06:06 on dist-test-slave-xw35"
server_key: "a7ccfa5ac63a71961516107eac5b1efe"
server_key_iv: "8260fec11bf400fac47e27703ad9b976"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:07.698058 13985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:07.718448 13985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:07.720355 13985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:07.720503 13985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:07.724471 13985 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:46797
I20260620 22:06:07.724507 14053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:46797 every 8 connection(s)
I20260620 22:06:07.724874 13985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:07.726079 14054 sys_catalog.cc:263] Verifying existing consensus state
I20260620 22:06:07.726593 14054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Bootstrap starting.
I20260620 22:06:07.733976 14054 log.cc:824] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:07.734159 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 13985
I20260620 22:06:07.734427 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:43087/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:37705
--local_ip_for_outbound_sockets=127.1.55.193
--tserver_master_addrs=127.1.55.254:46797
--webserver_port=43089
--webserver_interface=127.1.55.193
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.55.212:43087/kms with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:07.735546 14054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:06:07.735812 14054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Bootstrap complete.
I20260620 22:06:07.738117 14054 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } }
I20260620 22:06:07.738364 14054 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5785051528c4d2c9d3638f1f52c7e4a, State: Initialized, Role: FOLLOWER
I20260620 22:06:07.738555 14054 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } }
I20260620 22:06:07.738649 14054 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:06:07.738703 14054 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:06:07.738754 14054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 1 FOLLOWER]: Advancing to term 2
I20260620 22:06:07.739734 14054 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } }
I20260620 22:06:07.739845 14054 leader_election.cc:302] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5785051528c4d2c9d3638f1f52c7e4a; no voters:
I20260620 22:06:07.740036 14054 leader_election.cc:288] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260620 22:06:07.740073 14058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260620 22:06:07.740185 14058 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [term 2 LEADER]: Becoming Leader. State: Replica: b5785051528c4d2c9d3638f1f52c7e4a, State: Running, Role: LEADER
I20260620 22:06:07.740267 14058 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } }
I20260620 22:06:07.740288 14054 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:07.740522 14058 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5785051528c4d2c9d3638f1f52c7e4a. Latest consensus state: current_term: 2 leader_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } } }
I20260620 22:06:07.740586 14058 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:07.740525 14060 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5785051528c4d2c9d3638f1f52c7e4a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46797 } } }
I20260620 22:06:07.740628 14060 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:07.741657 14062 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:07.741751 14054 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260620 22:06:07.742118 14062 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:06:07.744089 14062 catalog_manager.cc:1259] Loaded cluster ID: 489c341a4d9a44d6875cf411a7c334a8
I20260620 22:06:07.744218 14062 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:06:07.745952 14062 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:06:07.746143 14062 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Loaded TSK: 0
I20260620 22:06:07.746373 14062 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 22:06:07.818151 14057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:07.818420 14057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:07.818459 14057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:07.819888 14057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:07.819952 14057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:07.819993 14057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:06:07.821555 14057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.55.212:43087/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:37705
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=43089
--tserver_master_addrs=127.1.55.254:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:07.821777 14057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:07.821964 14057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:07.826774 14091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:07.826797 14094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:07.827065 14092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:07.827281 14057 server_base.cc:1034] running on GCE node
I20260620 22:06:07.827453 14057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:07.827695 14057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:07.830963 14057 hybrid_clock.cc:648] HybridClock initialized: now 1781993167830945 us; error 29 us; skew 500 ppm
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:07.833371 14057 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:06:07.833855 14057 webserver.cc:460] Webserver started at http://127.1.55.193:43089/ using document root <none> and password file <none>
I20260620 22:06:07.834084 14057 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:07.834146 14057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:07.854245 14057 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:07.855105 14102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.855253 14057 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:07.855327 14057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "69dfd73592c94f378b1369db0c3cb134"
format_stamp: "Formatted at 2026-06-20 22:06:06 on dist-test-slave-xw35"
server_key: "a99a596b90b5842c4d447884addddd7a"
server_key_iv: "7901ffb47658a1ae527b52ff38a926c7"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:07.855744 14057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:07.887676 14057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:07.889909 14057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:07.890064 14057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:07.890311 14057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:07.890648 14057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:07.890707 14057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.890746 14057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:07.890769 14057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:07.897258 14057 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:37705
I20260620 22:06:07.897382 14215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:37705 every 8 connection(s)
I20260620 22:06:07.897688 14057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:06:07.899626 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 14057
I20260620 22:06:07.899876 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:43087/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:43847
--local_ip_for_outbound_sockets=127.1.55.194
--tserver_master_addrs=127.1.55.254:46797
--webserver_port=34877
--webserver_interface=127.1.55.194
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.55.212:43087/kms with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 22:06:07 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993167, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:07.912868 14218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:07.898390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46797 (local address 127.1.55.193:39981)
0620 22:06:07.898940 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:07.898973 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:07.901433 (+ 2460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:07.902089 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:07.902094 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:07.902308 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:07.902480 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:07.902484 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.904114 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.904115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:07.905432 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:07.905435 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.906445 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.906446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:07.906577 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:07.907104 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:07.907113 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:07.908807 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:07.911138 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:07.911144 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:07.911146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:07.911426 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:07.911688 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:07.911689 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:07.911689 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:07.911828 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:07.912288 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:07.912293 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:07.912417 (+ 124us) client_negotiation.cc:769] Sending connection context
0620 22:06:07.912538 (+ 121us) client_negotiation.cc:240] Negotiation successful
0620 22:06:07.912661 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":82,"threads_started":1}
I20260620 22:06:07.913501 14219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:07.898460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:39981 (local address 127.1.55.254:46797)
0620 22:06:07.898640 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:07.898649 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:07.899085 (+ 436us) server_negotiation.cc:407] Connection header received
0620 22:06:07.901726 (+ 2641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:07.901733 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:07.901796 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:07.901898 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:07.902582 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.903994 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.905561 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:07.906219 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:07.906305 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:07.908955 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:07.908959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:07.908960 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:07.908972 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:07.911046 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:07.911515 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:07.911518 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:07.911519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:07.911615 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:07.911902 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:07.911903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:07.911903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:07.912182 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:07.912261 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:07.913195 (+ 934us) server_negotiation.cc:299] Negotiation successful
0620 22:06:07.913293 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
I20260620 22:06:07.914494 14216 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46797
I20260620 22:06:07.914570 14216 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:07.914722 14216 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
W20260620 22:06:07.915464 14216 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:46797 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 22:06:07.915525 14216 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:07.915580 14216 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:07.915864 14216 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:07.915925 14216 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
W20260620 22:06:07.916178 14216 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 22:06:08.002715 14220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:08.002907 14220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:08.002939 14220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:08.003934 14220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:08.003993 14220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:08.004031 14220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:06:08.005681 14220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.55.212:43087/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:43847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=34877
--tserver_master_addrs=127.1.55.254:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:08.005901 14220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:08.006105 14220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:08.014230 14225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:08.014499 14226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:08.015403 14220 server_base.cc:1034] running on GCE node
W20260620 22:06:08.021889 14228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:08.022130 14220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:08.022404 14220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:08.023588 14220 hybrid_clock.cc:648] HybridClock initialized: now 1781993168023558 us; error 43 us; skew 500 ppm
Jun 20 22:06:08 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:08.026496 14220 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:06:08.026994 14220 webserver.cc:460] Webserver started at http://127.1.55.194:34877/ using document root <none> and password file <none>
I20260620 22:06:08.027220 14220 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:08.027316 14220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 20 22:06:08 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:08.043584 14220 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:08.045939 14236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:08.046101 14220 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:08.046185 14220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "63913ddab2b04336b901dbe1e4c44d10"
format_stamp: "Formatted at 2026-06-20 22:06:07 on dist-test-slave-xw35"
server_key: "ec5ee81ac79f4ade470bd7663d68e878"
server_key_iv: "f383c40cae26d3625866717f1f0e18a2"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:08.046623 14220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:08.065946 14220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:08.068125 14220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:08.068285 14220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:08.068529 14220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:08.068886 14220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:08.068936 14220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:08.068972 14220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:08.069003 14220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:08.076247 14220 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:43847
I20260620 22:06:08.076412 14349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:43847 every 8 connection(s)
I20260620 22:06:08.076733 14220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:06:08 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:08.086323 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 14220
I20260620 22:06:08.086584 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.55.212:43087/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:35303
--local_ip_for_outbound_sockets=127.1.55.195
--tserver_master_addrs=127.1.55.254:46797
--webserver_port=40917
--webserver_interface=127.1.55.195
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.55.212:43087/kms with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:08.090972 14219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:08.077438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:35065 (local address 127.1.55.254:46797)
0620 22:06:08.077481 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:08.077499 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:08.077746 (+ 247us) server_negotiation.cc:407] Connection header received
0620 22:06:08.078447 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:08.078449 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:08.078466 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:08.078534 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:08.079212 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.079796 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.081253 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.081455 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.081575 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:08.083769 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:08.083770 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:08.083771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:08.083778 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:08.085357 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:08.085833 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:08.085834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:08.085834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:08.085884 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:08.088232 (+ 2348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:08.088233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:08.088233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:08.088340 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:08.088438 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:08.090809 (+ 2371us) server_negotiation.cc:299] Negotiation successful
0620 22:06:08.090891 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:06:08.091295 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:08.077438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46797 (local address 127.1.55.194:35065)
0620 22:06:08.077606 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:08.077649 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:08.078298 (+ 649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:08.078601 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:08.078605 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:08.078812 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:08.079084 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:08.079091 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.079895 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.079896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:08.081135 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:08.081138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.081604 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.081605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:08.081757 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:08.082187 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:08.082196 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:08.083630 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:08.085441 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:08.085447 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:08.085449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:08.085754 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:08.085955 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:08.085956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:08.085957 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:08.086096 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:08.088944 (+ 2848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:08.088949 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:08.089086 (+ 137us) client_negotiation.cc:769] Sending connection context
0620 22:06:08.090787 (+ 1701us) client_negotiation.cc:240] Negotiation successful
0620 22:06:08.090918 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":98,"threads_started":1}
I20260620 22:06:08.091742 14350 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46797
I20260620 22:06:08.091847 14350 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:08.092032 14350 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
W20260620 22:06:08.095310 14350 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:46797 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 22:06:08.095403 14350 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:08.095471 14350 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:08.095800 14350 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:08.095867 14350 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
W20260620 22:06:08.096153 14350 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 22:06:08.200700 14353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:08.200939 14353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:08.200976 14353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:08.202644 14353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:08.202713 14353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:08.202754 14353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:06:08.204782 14353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.55.212:43087/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:35303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=40917
--tserver_master_addrs=127.1.55.254:46797
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:08.205008 14353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:08.205217 14353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:08.211500 14360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:08.211763 14359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:08.211818 14353 server_base.cc:1034] running on GCE node
W20260620 22:06:08.212298 14362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:08.212533 14353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:08.212761 14353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:08.216068 14353 hybrid_clock.cc:648] HybridClock initialized: now 1781993168215859 us; error 220 us; skew 500 ppm
Jun 20 22:06:08 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:08.219059 14353 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:06:08.219540 14353 webserver.cc:460] Webserver started at http://127.1.55.195:40917/ using document root <none> and password file <none>
I20260620 22:06:08.219825 14353 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:08.219890 14353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 20 22:06:08 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:08.245731 14353 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260620 22:06:08.247012 14370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:08.247144 14353 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:08.247211 14353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "2cf6da09cc6f47138215eff2a2778ed2"
format_stamp: "Formatted at 2026-06-20 22:06:07 on dist-test-slave-xw35"
server_key: "760dda7820270a441f105733cd21dd2b"
server_key_iv: "7ee36c7eb4637a5fbfe4197573d14c9b"
server_key_version: "kuduclusterkey@0"
I20260620 22:06:08.247601 14353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:08.257880 14353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:08.260257 14353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:08.260404 14353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:08.260620 14353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:08.260941 14353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:08.260991 14353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:08.261021 14353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:08.261044 14353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:08.267021 14353 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:35303
I20260620 22:06:08.267321 14483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:35303 every 8 connection(s)
I20260620 22:06:08.267431 14353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:06:08.273778 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 14353
Jun 20 22:06:08 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:08.277724 14486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:08.268509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46797 (local address 127.1.55.195:50109)
0620 22:06:08.269572 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:08.269614 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:08.270108 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:08.270359 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:08.270363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:08.270517 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:08.270681 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:08.270684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.271309 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.271310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:08.272009 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:08.272011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.272457 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.272459 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:08.272597 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:08.273110 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:08.273120 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:08.274599 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:08.276101 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:08.276107 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:08.276109 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:08.276391 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:08.276626 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:08.276627 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:08.276627 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:08.276784 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:08.277084 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:08.277089 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:08.277244 (+ 155us) client_negotiation.cc:769] Sending connection context
0620 22:06:08.277346 (+ 102us) client_negotiation.cc:240] Negotiation successful
0620 22:06:08.277476 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1021,"thread_start_us":80,"threads_started":1}
I20260620 22:06:08.278131 14219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:08.268782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:50109 (local address 127.1.55.254:46797)
0620 22:06:08.268836 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:08.268838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:08.269691 (+ 853us) server_negotiation.cc:407] Connection header received
0620 22:06:08.270218 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:08.270219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:08.270231 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:08.270299 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:08.270770 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.271213 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.272098 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.272333 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.272397 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:08.274707 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:08.274708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:08.274708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:08.274714 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:08.276021 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:08.276461 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:08.276462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:08.276462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:08.276548 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:08.276867 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:08.276868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:08.276869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:08.276998 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:08.277057 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:08.277967 (+ 910us) server_negotiation.cc:299] Negotiation successful
0620 22:06:08.278047 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260620 22:06:08.278483 14484 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46797
I20260620 22:06:08.278563 14484 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:08.278738 14484 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
W20260620 22:06:08.279381 14484 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:46797 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 22:06:08.279460 14484 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:08.279532 14484 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:08.279924 14484 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:08.280004 14484 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
W20260620 22:06:08.280328 14484 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 22:06:08.284967 14487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:08.274166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53138 (local address 127.1.55.254:46797)
0620 22:06:08.276564 (+ 2398us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:08.276566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:08.276573 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:06:08.276594 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:08.276594 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:08.276606 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:08.276669 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:08.277436 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.278101 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.279269 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:08.279564 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:08.279638 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:08.281137 (+ 1499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:08.281138 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:08.281138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:08.281145 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:08.282749 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:08.283203 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:08.283204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:08.283205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:08.283269 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:08.284478 (+ 1209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:08.284479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:08.284479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:08.284579 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:08.284757 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:08.284790 (+ 33us) server_negotiation.cc:299] Negotiation successful
0620 22:06:08.284865 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2378,"thread_start_us":54,"threads_started":1}
Jun 20 22:06:08 dist-test-slave-xw35 krb5kdc[13022](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:08.916350 14216 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:08.916482 14216 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:08.916810 14018 ts_manager.cc:194] Registered new tserver with Master: 69dfd73592c94f378b1369db0c3cb134 (127.1.55.193:37705)
I20260620 22:06:08.917735 14018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:39981
Jun 20 22:06:09 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:09.096331 14350 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:09.096463 14350 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:09.096740 14018 ts_manager.cc:194] Registered new tserver with Master: 63913ddab2b04336b901dbe1e4c44d10 (127.1.55.194:43847)
I20260620 22:06:09.097195 14018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:35065
I20260620 22:06:09.280520 14484 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:09.280642 14484 heartbeater.cc:511] Master 127.1.55.254:46797 requested a full tablet report, sending...
I20260620 22:06:09.280903 14018 ts_manager.cc:194] Registered new tserver with Master: 2cf6da09cc6f47138215eff2a2778ed2 (127.1.55.195:35303)
I20260620 22:06:09.281419 14018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:50109
I20260620 22:06:09.285619 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 20 22:06:09 dist-test-slave-xw35 krb5kdc[13022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993168, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for HTTP/127.1.55.212@KRBTEST.COM
I20260620 22:06:09.303560 14507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.286603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53152 (local address 127.1.55.254:46797)
0620 22:06:09.286969 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:09.286970 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:09.286977 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:06:09.286997 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:09.286998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:09.287009 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:09.287068 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:09.288012 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.289088 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.290128 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.290378 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.290436 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.300205 (+ 9769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:09.300206 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:09.300206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:09.300214 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:09.302099 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:09.302487 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:09.302488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:09.302489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:09.302547 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:09.302733 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:09.302734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:09.302734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:09.302869 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:09.302955 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:09.303378 (+ 423us) server_negotiation.cc:299] Negotiation successful
0620 22:06:09.303455 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":47,"threads_started":1}
I20260620 22:06:09.305624 14018 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:06:09.307920 14018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:06:09.326071 14514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.316024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:37705 (local address 127.0.0.1:35376)
0620 22:06:09.321854 (+ 5830us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:09.321862 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:09.321900 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:09.322146 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:09.322149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:09.322150 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:09.322209 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.322211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.323332 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.323333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.324728 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.324731 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.325764 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.325765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.325838 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.325851 (+ 13us) client_negotiation.cc:769] Sending connection context
0620 22:06:09.325923 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 22:06:09.325977 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5818,"thread_start_us":71,"threads_started":1}
I20260620 22:06:09.326596 14515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.316122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35376 (local address 127.1.55.193:37705)
0620 22:06:09.321810 (+ 5688us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:09.321815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:09.321945 (+ 130us) server_negotiation.cc:407] Connection header received
0620 22:06:09.321979 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:09.321981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:09.321995 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:09.322054 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:09.322275 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.323247 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.324824 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.325589 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.325658 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.325716 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:09.326481 (+ 765us) server_negotiation.cc:299] Negotiation successful
0620 22:06:09.326522 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5654,"thread_start_us":52,"threads_started":1}
I20260620 22:06:09.327407 14150 tablet_service.cc:1467] Processing CreateTablet for tablet 3e3176a024ee49a5b499e199e88d566e (DEFAULT_TABLE table=test-table [id=83fe567a368041cb8b9bc312306cac4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:09.327805 14150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e3176a024ee49a5b499e199e88d566e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:09.329211 14516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.316226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:35303 (local address 127.0.0.1:40180)
0620 22:06:09.325539 (+ 9313us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:09.325549 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:09.325599 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:09.325893 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:09.325894 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:09.325896 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:09.325933 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.325934 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.327039 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.327040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.328077 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.328080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.329009 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.329010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.329079 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.329083 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:09.329115 (+ 32us) client_negotiation.cc:240] Negotiation successful
0620 22:06:09.329149 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9297,"thread_start_us":71,"threads_started":1}
I20260620 22:06:09.329633 14517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.316321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40180 (local address 127.1.55.195:35303)
0620 22:06:09.325698 (+ 9377us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:09.325703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:09.325711 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:09.325743 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:09.325745 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:09.325759 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:09.325823 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:09.325995 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.326942 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.328175 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.328913 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.329392 (+ 479us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.329469 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:09.329528 (+ 59us) server_negotiation.cc:299] Negotiation successful
0620 22:06:09.329565 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9346,"thread_start_us":47,"threads_started":1}
I20260620 22:06:09.330199 14417 tablet_service.cc:1467] Processing CreateTablet for tablet 3e3176a024ee49a5b499e199e88d566e (DEFAULT_TABLE table=test-table [id=83fe567a368041cb8b9bc312306cac4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:09.330523 14417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e3176a024ee49a5b499e199e88d566e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:09.331507 14518 tablet_bootstrap.cc:492] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134: Bootstrap starting.
I20260620 22:06:09.332365 14518 tablet_bootstrap.cc:654] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:09.332720 14518 log.cc:824] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:09.333981 14520 tablet_bootstrap.cc:492] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: Bootstrap starting.
I20260620 22:06:09.334641 14520 tablet_bootstrap.cc:654] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:09.334976 14520 log.cc:824] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:09.335026 14512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.315786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:43847 (local address 127.0.0.1:43000)
0620 22:06:09.321561 (+ 5775us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:09.321601 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:09.321669 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:09.331938 (+ 10269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:09.331939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:09.331941 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:09.331976 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.331978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.333122 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.333123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.334037 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.334039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.334854 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.334856 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.334908 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.334911 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:06:09.334936 (+ 25us) client_negotiation.cc:240] Negotiation successful
0620 22:06:09.334965 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5744,"thread_start_us":71,"threads_started":1}
I20260620 22:06:09.335510 14513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.315875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43000 (local address 127.1.55.194:43847)
0620 22:06:09.331777 (+ 15902us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:09.331781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:09.331792 (+ 11us) server_negotiation.cc:407] Connection header received
0620 22:06:09.331823 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:09.331825 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:09.331839 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:09.332042 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:09.332117 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.333023 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.334118 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.334768 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.335300 (+ 532us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.335358 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:09.335379 (+ 21us) server_negotiation.cc:299] Negotiation successful
0620 22:06:09.335414 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15859,"thread_start_us":55,"threads_started":1}
I20260620 22:06:09.335754 14520 tablet_bootstrap.cc:492] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: No bootstrap required, opened a new log
I20260620 22:06:09.335819 14520 ts_tablet_manager.cc:1397] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:09.336164 14284 tablet_service.cc:1467] Processing CreateTablet for tablet 3e3176a024ee49a5b499e199e88d566e (DEFAULT_TABLE table=test-table [id=83fe567a368041cb8b9bc312306cac4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:09.336434 14284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e3176a024ee49a5b499e199e88d566e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:09.338152 14520 raft_consensus.cc:348] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.338289 14520 raft_consensus.cc:374] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:09.338326 14520 raft_consensus.cc:729] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf6da09cc6f47138215eff2a2778ed2, State: Initialized, Role: FOLLOWER
I20260620 22:06:09.338438 14520 consensus_queue.cc:260] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.338689 14484 heartbeater.cc:503] Master 127.1.55.254:46797 was elected leader, sending a full tablet report...
I20260620 22:06:09.339304 14524 tablet_bootstrap.cc:492] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: Bootstrap starting.
I20260620 22:06:09.339787 14520 ts_tablet_manager.cc:1428] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260620 22:06:09.339955 14524 tablet_bootstrap.cc:654] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:09.340281 14524 log.cc:824] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:09.341023 14524 tablet_bootstrap.cc:492] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: No bootstrap required, opened a new log
I20260620 22:06:09.341079 14524 ts_tablet_manager.cc:1397] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:09.343021 14524 raft_consensus.cc:348] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.343117 14524 raft_consensus.cc:374] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:09.343135 14524 raft_consensus.cc:729] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63913ddab2b04336b901dbe1e4c44d10, State: Initialized, Role: FOLLOWER
I20260620 22:06:09.343231 14524 consensus_queue.cc:260] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.343446 14524 ts_tablet_manager.cc:1428] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:09.343469 14350 heartbeater.cc:503] Master 127.1.55.254:46797 was elected leader, sending a full tablet report...
I20260620 22:06:09.345935 14518 tablet_bootstrap.cc:492] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134: No bootstrap required, opened a new log
I20260620 22:06:09.346001 14518 ts_tablet_manager.cc:1397] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20260620 22:06:09.348090 14518 raft_consensus.cc:348] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.348234 14518 raft_consensus.cc:374] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:09.348280 14518 raft_consensus.cc:729] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69dfd73592c94f378b1369db0c3cb134, State: Initialized, Role: FOLLOWER
I20260620 22:06:09.348395 14518 consensus_queue.cc:260] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.348594 14518 ts_tablet_manager.cc:1428] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:06:09.348692 14216 heartbeater.cc:503] Master 127.1.55.254:46797 was elected leader, sending a full tablet report...
W20260620 22:06:09.408107 14217 tablet.cc:2369] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:06:09.411760 14526 raft_consensus.cc:482] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:09.411909 14526 raft_consensus.cc:504] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.412338 14526 leader_election.cc:288] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69dfd73592c94f378b1369db0c3cb134 (127.1.55.193:37705), 2cf6da09cc6f47138215eff2a2778ed2 (127.1.55.195:35303)
I20260620 22:06:09.426379 14515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.412779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:54957 (local address 127.1.55.193:37705)
0620 22:06:09.412821 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:09.412822 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:09.413907 (+ 1085us) server_negotiation.cc:407] Connection header received
0620 22:06:09.414018 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:09.414019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:09.414032 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:09.414062 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:09.414300 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.415047 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.420049 (+ 5002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.420558 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.420608 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.420617 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:09.426261 (+ 5644us) server_negotiation.cc:299] Negotiation successful
0620 22:06:09.426310 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:06:09.426852 14528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.412561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:37705 (local address 127.1.55.194:54957)
0620 22:06:09.413831 (+ 1270us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:09.413845 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:09.413940 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:09.414142 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:09.414143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:09.414144 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:09.414223 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.414225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.416442 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.416442 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.417747 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.417750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.420914 (+ 3164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.420915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.420985 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.420989 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:09.426696 (+ 5707us) client_negotiation.cc:240] Negotiation successful
0620 22:06:09.426751 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1249,"thread_start_us":90,"threads_started":1}
I20260620 22:06:09.427330 14170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e3176a024ee49a5b499e199e88d566e" candidate_uuid: "63913ddab2b04336b901dbe1e4c44d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69dfd73592c94f378b1369db0c3cb134" is_pre_election: true
I20260620 22:06:09.427496 14170 raft_consensus.cc:2454] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63913ddab2b04336b901dbe1e4c44d10 in term 0.
I20260620 22:06:09.427840 14237 leader_election.cc:302] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63913ddab2b04336b901dbe1e4c44d10, 69dfd73592c94f378b1369db0c3cb134; no voters:
I20260620 22:06:09.427968 14526 raft_consensus.cc:2781] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:06:09.428054 14526 raft_consensus.cc:482] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:06:09.428087 14526 raft_consensus.cc:3037] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:09.428261 14517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.412751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:49789 (local address 127.1.55.195:35303)
0620 22:06:09.412797 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:09.412800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:09.419670 (+ 6870us) server_negotiation.cc:407] Connection header received
0620 22:06:09.419792 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:09.419793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:09.419805 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:09.419833 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:09.421113 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.421773 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.427251 (+ 5478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.427846 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.427897 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.427906 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:09.428130 (+ 224us) server_negotiation.cc:299] Negotiation successful
0620 22:06:09.428176 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:06:09.428468 14529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.412560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:35303 (local address 127.1.55.194:49789)
0620 22:06:09.419595 (+ 7035us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:09.419607 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:09.419699 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:09.419895 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:09.419895 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:09.419897 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:09.419959 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.419960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.425063 (+ 5103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.425064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.426157 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:09.426160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.427972 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.427973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:09.428043 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.428047 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:09.428363 (+ 316us) client_negotiation.cc:240] Negotiation successful
0620 22:06:09.428401 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7017,"mutex_wait_us":13,"thread_start_us":81,"threads_started":1}
I20260620 22:06:09.428764 14419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e3176a024ee49a5b499e199e88d566e" candidate_uuid: "63913ddab2b04336b901dbe1e4c44d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf6da09cc6f47138215eff2a2778ed2" is_pre_election: true
I20260620 22:06:09.428905 14419 raft_consensus.cc:2454] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63913ddab2b04336b901dbe1e4c44d10 in term 0.
I20260620 22:06:09.429049 14526 raft_consensus.cc:504] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.429203 14526 leader_election.cc:288] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [CANDIDATE]: Term 1 election: Requested vote from peers 69dfd73592c94f378b1369db0c3cb134 (127.1.55.193:37705), 2cf6da09cc6f47138215eff2a2778ed2 (127.1.55.195:35303)
I20260620 22:06:09.429550 14419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e3176a024ee49a5b499e199e88d566e" candidate_uuid: "63913ddab2b04336b901dbe1e4c44d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf6da09cc6f47138215eff2a2778ed2"
I20260620 22:06:09.429627 14419 raft_consensus.cc:3037] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:09.430348 14419 raft_consensus.cc:2454] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63913ddab2b04336b901dbe1e4c44d10 in term 1.
I20260620 22:06:09.430541 14240 leader_election.cc:302] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cf6da09cc6f47138215eff2a2778ed2, 63913ddab2b04336b901dbe1e4c44d10; no voters:
I20260620 22:06:09.430719 14526 raft_consensus.cc:2781] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:09.430776 14170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e3176a024ee49a5b499e199e88d566e" candidate_uuid: "63913ddab2b04336b901dbe1e4c44d10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69dfd73592c94f378b1369db0c3cb134"
I20260620 22:06:09.430859 14526 raft_consensus.cc:686] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 1 LEADER]: Becoming Leader. State: Replica: 63913ddab2b04336b901dbe1e4c44d10, State: Running, Role: LEADER
I20260620 22:06:09.430848 14170 raft_consensus.cc:3037] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:09.430939 14526 consensus_queue.cc:237] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } }
I20260620 22:06:09.431696 14170 raft_consensus.cc:2454] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63913ddab2b04336b901dbe1e4c44d10 in term 1.
I20260620 22:06:09.431766 14018 catalog_manager.cc:5495] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63913ddab2b04336b901dbe1e4c44d10 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "63913ddab2b04336b901dbe1e4c44d10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63913ddab2b04336b901dbe1e4c44d10" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 } health_report { overall_health: UNKNOWN } } }
I20260620 22:06:09.444923 14513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:09.441819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43012 (local address 127.1.55.194:43847)
0620 22:06:09.441858 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:09.441860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:09.441871 (+ 11us) server_negotiation.cc:407] Connection header received
0620 22:06:09.441961 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:09.441962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:09.441981 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:09.442043 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:06:09.442212 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.442856 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.443933 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:09.444214 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:09.444276 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:09.444454 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:06:09.444559 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:06:09.444627 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:09.444847 (+ 220us) server_negotiation.cc:299] Negotiation successful
0620 22:06:09.444864 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:06:09.462503 14419 raft_consensus.cc:1261] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 1 FOLLOWER]: Refusing update from remote peer 63913ddab2b04336b901dbe1e4c44d10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:09.462790 14170 raft_consensus.cc:1261] T 3e3176a024ee49a5b499e199e88d566e P 69dfd73592c94f378b1369db0c3cb134 [term 1 FOLLOWER]: Refusing update from remote peer 63913ddab2b04336b901dbe1e4c44d10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:09.463327 14530 consensus_queue.cc:1035] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69dfd73592c94f378b1369db0c3cb134" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:09.463507 14530 consensus_queue.cc:1035] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cf6da09cc6f47138215eff2a2778ed2" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 35303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:09.471307 14534 mvcc.cc:205] Tried to move back new op lower bound from 7299044022115426304 to 7299044021989572608. Current Snapshot: MvccSnapshot[applied={T|T < 7299044022115426304}]
I20260620 22:06:09.473453 14536 mvcc.cc:205] Tried to move back new op lower bound from 7299044022115426304 to 7299044021989572608. Current Snapshot: MvccSnapshot[applied={T|T < 7299044022115426304}]
I20260620 22:06:09.479174 14017 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:09.479281 14017 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:09.480100 14017 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b5785051528c4d2c9d3638f1f52c7e4a: Sending DeleteTablet for 3 replicas of tablet 3e3176a024ee49a5b499e199e88d566e
I20260620 22:06:09.480553 14150 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e3176a024ee49a5b499e199e88d566e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:09 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:35376
I20260620 22:06:09.480786 14417 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e3176a024ee49a5b499e199e88d566e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:09 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:40180
I20260620 22:06:09.481211 14284 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e3176a024ee49a5b499e199e88d566e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:09 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:43000
I20260620 22:06:09.481822 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 14057
W20260620 22:06:09.488999 14002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:37705 (error 108)
I20260620 22:06:09.491113 14543 tablet_replica.cc:330] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: stopping tablet replica
I20260620 22:06:09.491319 14544 tablet_replica.cc:330] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: stopping tablet replica
I20260620 22:06:09.491477 14544 raft_consensus.cc:2229] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:06:09.491612 14543 raft_consensus.cc:2229] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:09.491926 14544 raft_consensus.cc:2258] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:09.492081 14543 raft_consensus.cc:2258] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:09.492730 14543 ts_tablet_manager.cc:1905] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:09.493022 14544 ts_tablet_manager.cc:1905] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:09.494756 14544 ts_tablet_manager.cc:1918] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:09.496388 14543 ts_tablet_manager.cc:1918] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:09.501349 14543 log.cc:1196] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/3e3176a024ee49a5b499e199e88d566e
I20260620 22:06:09.501864 14543 ts_tablet_manager.cc:1939] T 3e3176a024ee49a5b499e199e88d566e P 2cf6da09cc6f47138215eff2a2778ed2: Deleting consensus metadata
I20260620 22:06:09.501549 14544 log.cc:1196] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/3e3176a024ee49a5b499e199e88d566e
I20260620 22:06:09.502238 14544 ts_tablet_manager.cc:1939] T 3e3176a024ee49a5b499e199e88d566e P 63913ddab2b04336b901dbe1e4c44d10: Deleting consensus metadata
I20260620 22:06:09.503422 14005 catalog_manager.cc:4841] TS 2cf6da09cc6f47138215eff2a2778ed2 (127.1.55.195:35303): tablet 3e3176a024ee49a5b499e199e88d566e (table test-table [id=83fe567a368041cb8b9bc312306cac4b]) successfully deleted
I20260620 22:06:09.504048 14003 catalog_manager.cc:4841] TS 63913ddab2b04336b901dbe1e4c44d10 (127.1.55.194:43847): tablet 3e3176a024ee49a5b499e199e88d566e (table test-table [id=83fe567a368041cb8b9bc312306cac4b]) successfully deleted
W20260620 22:06:09.504302 14512 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:06:09.489405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:37705 (local address 127.0.0.1:35386)
0620 22:06:09.489474 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:09.489505 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:09.489547 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:09.504259 (+ 14712us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:37705: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":38}
W20260620 22:06:09.504444 14002 catalog_manager.cc:4584] TS 69dfd73592c94f378b1369db0c3cb134 (127.1.55.193:37705): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3e3176a024ee49a5b499e199e88d566e: Network error: Client connection negotiation failed: client connection to 127.1.55.193:37705: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 22:06:09.505002 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 14220
I20260620 22:06:09.511332 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 14353
I20260620 22:06:09.517386 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 13985
I20260620 22:06:09.524721 1247 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260620 22:06:09.859292 1247 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260620 22:06:09.859373 1247 mini_ranger.cc:66] Stopping Ranger...
I20260620 22:06:10.203316 1247 mini_ranger.cc:68] Stopped Ranger
2026-06-20 22:06:10.203 UTC [13052] LOG: received smart shutdown request
2026-06-20 22:06:10.207 UTC [13052] LOG: background worker "logical replication launcher" (PID 13061) exited with exit code 1
2026-06-20 22:06:10.207 UTC [13056] LOG: shutting down
2026-06-20 22:06:10.351 UTC [13052] LOG: database system is shut down
2026-06-20T22:06:10Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (43383 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:06:10 dist-test-slave-xw35 krb5kdc[14554](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:06:10 dist-test-slave-xw35 krb5kdc[14554](info): set up 2 sockets
Jun 20 22:06:10 dist-test-slave-xw35 krb5kdc[14554](info): commencing operation
krb5kdc: starting...
W20260620 22:06:11.441359 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.967s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:06:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:06:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:06:11.547720 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45631
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:44585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45631,127.1.55.253:39583,127.1.55.252:38651
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:11.627693 14567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:11.627892 14567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:11.627913 14567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:11.628937 14567 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:11.628970 14567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:11.628984 14567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:11.628997 14567 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:11.629011 14567 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:11.630407 14567 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:44585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45631,127.1.55.253:39583,127.1.55.252:38651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:11.630573 14567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:11.630748 14567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:11.635067 14573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:11.635170 14572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:11.635109 14575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:11.635352 14567 server_base.cc:1034] running on GCE node
I20260620 22:06:11.635628 14567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:11.635905 14567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:11.637091 14567 hybrid_clock.cc:648] HybridClock initialized: now 1781993171637068 us; error 34 us; skew 500 ppm
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:11.639595 14567 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:11.639995 14567 webserver.cc:460] Webserver started at http://127.1.55.254:44361/ using document root <none> and password file <none>
I20260620 22:06:11.640245 14567 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:11.640312 14567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:11.640452 14567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:11.641558 14567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "43ddb79688ab437283a64bf7833ce2e2"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "bd540fddf9763e6e965aa84d3b023d5f"
server_key_iv: "c0a8eff164820ed1a6da093a200879af"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.641891 14567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "43ddb79688ab437283a64bf7833ce2e2"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "bd540fddf9763e6e965aa84d3b023d5f"
server_key_iv: "c0a8eff164820ed1a6da093a200879af"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.643077 14567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:11.643671 14582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:11.643807 14567 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:06:11.643894 14567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "43ddb79688ab437283a64bf7833ce2e2"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "bd540fddf9763e6e965aa84d3b023d5f"
server_key_iv: "c0a8eff164820ed1a6da093a200879af"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.643965 14567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:11.661468 14567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:11.663676 14567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:11.663816 14567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:11.667569 14567 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:45631
I20260620 22:06:11.667614 14634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:45631 every 8 connection(s)
I20260620 22:06:11.667963 14567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:11.668753 14635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:11.670110 14635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:06:11.671772 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 14567
I20260620 22:06:11.671875 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:06:11.672107 1247 external_mini_cluster.cc:1428] Setting key 977e25f7d35c1444bc70826711281775
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.55.253@KRBTEST.COM; defaulting to no policy
I20260620 22:06:11.679551 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.670629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45631 (local address 127.0.0.1:42098)
0620 22:06:11.670790 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.670817 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:11.671169 (+ 352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:11.671493 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:11.671496 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:11.671802 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:11.672072 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.672078 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.673059 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.673060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.673904 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.673907 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.674494 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.674495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.674573 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.674960 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:11.674969 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:11.676440 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:11.678115 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.678120 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.678122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.678315 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.678587 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.678588 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.678589 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.678673 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.679017 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:11.679022 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:11.679079 (+ 57us) client_negotiation.cc:769] Sending connection context
0620 22:06:11.679170 (+ 91us) client_negotiation.cc:240] Negotiation successful
0620 22:06:11.679391 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":95,"thread_start_us":82,"threads_started":1}
I20260620 22:06:11.679561 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.670656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42098 (local address 127.1.55.254:45631)
0620 22:06:11.671278 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.671281 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.671290 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:06:11.671338 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.671339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.671368 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.671440 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.672192 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.672958 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.673983 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.674419 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.674490 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.676535 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:11.676541 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:11.676542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:11.676548 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:11.678016 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.678405 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.678407 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.678408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.678484 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.678739 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.678740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.678740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.678926 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:11.679032 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:11.679197 (+ 165us) server_negotiation.cc:299] Negotiation successful
0620 22:06:11.679332 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":70,"threads_started":1}
I20260620 22:06:11.680389 14635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:06:11.680665 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.680564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:55996)
0620 22:06:11.680612 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.680648 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260620 22:06:11.680780 14584 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
I20260620 22:06:11.681113 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.681031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:56006)
0620 22:06:11.681073 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.681095 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.253@KRBTEST.COM" created.
W20260620 22:06:11.681238 14635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:39583: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab.
Entry for principal kudu/127.1.55.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab.
I20260620 22:06:11.693987 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.253:39583
--webserver_interface=127.1.55.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab
--principal=kudu/127.1.55.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:44585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45631,127.1.55.253:39583,127.1.55.252:38651
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:11.730423 14635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } attempt: 1
I20260620 22:06:11.730772 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.730658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:56016)
0620 22:06:11.730713 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.730744 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260620 22:06:11.731086 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.731001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:56022)
0620 22:06:11.731043 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.731064 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260620 22:06:11.731158 14635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:39583: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
W20260620 22:06:11.767622 14642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:11.767817 14642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:11.767838 14642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:11.768966 14642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:11.769007 14642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:11.769021 14642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:11.769062 14642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:11.769090 14642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:11.770458 14642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:44585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45631,127.1.55.253:39583,127.1.55.252:38651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab
--principal=kudu/127.1.55.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.253:39583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.55.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:11.770696 14642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:11.770906 14642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:11.775524 14650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:11.775543 14648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:11.775507 14647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:11.775604 14642 server_base.cc:1034] running on GCE node
I20260620 22:06:11.775899 14642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:11.776149 14642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:11.777309 14642 hybrid_clock.cc:648] HybridClock initialized: now 1781993171777303 us; error 35 us; skew 500 ppm
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:11.779759 14642 init.cc:377] Logged in from keytab as kudu/127.1.55.253@KRBTEST.COM (short username kudu)
I20260620 22:06:11.780092 14642 webserver.cc:460] Webserver started at http://127.1.55.253:38735/ using document root <none> and password file <none>
I20260620 22:06:11.780236 14642 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:11.780273 14642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:11.780345 14642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:11.781301 14642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/data/instance:
uuid: "5a4a5bbd033942ccaa4429a9b700a333"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "4e0adc8938c72413688d44552df43f13"
server_key_iv: "408a405546acf9a330454badb7368eee"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.781646 14642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/wal/instance:
uuid: "5a4a5bbd033942ccaa4429a9b700a333"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "4e0adc8938c72413688d44552df43f13"
server_key_iv: "408a405546acf9a330454badb7368eee"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.782709 14642 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:11.783289 14657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:11.783457 14642 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:06:11.783519 14642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/wal
uuid: "5a4a5bbd033942ccaa4429a9b700a333"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "4e0adc8938c72413688d44552df43f13"
server_key_iv: "408a405546acf9a330454badb7368eee"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.783596 14642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:11.799291 14635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } attempt: 2
I20260620 22:06:11.799665 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.799541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:56034)
0620 22:06:11.799599 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.799637 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260620 22:06:11.799961 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.799895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:56038)
0620 22:06:11.799919 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.799944 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260620 22:06:11.800079 14635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:39583: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39583: connect: Connection refused (error 111)
I20260620 22:06:11.808219 14642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:11.810392 14642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:11.810539 14642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:11.814090 14642 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.253:39583
I20260620 22:06:11.814121 14709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.253:39583 every 8 connection(s)
I20260620 22:06:11.814412 14642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
I20260620 22:06:11.815161 14710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:11.816509 14710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:06:11.817873 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 14642
I20260620 22:06:11.817962 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-1/wal/instance
I20260620 22:06:11.818158 1247 external_mini_cluster.cc:1428] Setting key 6420f6a312ed0e3942a76e7f07de1539
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.55.252@KRBTEST.COM; defaulting to no policy
I20260620 22:06:11.825788 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.817082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42104 (local address 127.1.55.254:45631)
0620 22:06:11.817134 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.817136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.817307 (+ 171us) server_negotiation.cc:407] Connection header received
0620 22:06:11.817768 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.817769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.817781 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.817851 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.818532 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.819280 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.820685 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.821032 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.821103 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.823010 (+ 1907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:11.823012 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:11.823012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:11.823021 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:11.824502 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.824863 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.824864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.824865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.824923 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.825132 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.825133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.825134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.825271 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:11.825345 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:11.825587 (+ 242us) server_negotiation.cc:299] Negotiation successful
0620 22:06:11.825660 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 22:06:11.825902 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.817070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45631 (local address 127.0.0.1:42104)
0620 22:06:11.817201 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.817235 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:11.817669 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:11.817889 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:11.817892 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:11.818245 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:11.818442 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.818446 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.819388 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.819389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.820607 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.820609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.821113 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.821113 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.821203 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.821681 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:11.821688 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:11.822923 (+ 1235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:11.824586 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.824592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.824593 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.824785 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.824988 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.824989 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.824989 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.825069 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.825337 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:11.825341 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:11.825435 (+ 94us) client_negotiation.cc:769] Sending connection context
0620 22:06:11.825549 (+ 114us) client_negotiation.cc:240] Negotiation successful
0620 22:06:11.825647 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":67,"threads_started":1}
I20260620 22:06:11.826401 14710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.252@KRBTEST.COM" created.
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:06:11.833616 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.826625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:56054)
0620 22:06:11.826668 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.826677 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:11.826713 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:11.826903 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:11.826904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:11.826996 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:11.827055 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.827056 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.827950 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.827951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.828536 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.828538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.828960 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.828961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.829044 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.829425 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:11.829430 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:11.830751 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:11.832717 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.832718 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.832718 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.832853 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.833060 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.833060 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.833060 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.833103 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.833389 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:11.833390 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:11.833417 (+ 27us) client_negotiation.cc:769] Sending connection context
0620 22:06:11.833461 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 22:06:11.833568 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260620 22:06:11.833732 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.826653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56054 (local address 127.1.55.253:39583)
0620 22:06:11.826776 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.826780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.826798 (+ 18us) server_negotiation.cc:407] Connection header received
0620 22:06:11.826817 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.826819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.826832 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.826901 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.827128 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.827874 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.828616 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.828884 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.828940 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.830834 (+ 1894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:11.830842 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:11.830842 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:11.830849 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:11.832640 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.832928 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.832931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.832932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.832992 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.833165 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.833166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.833166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.833326 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:11.833405 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:11.833510 (+ 105us) server_negotiation.cc:299] Negotiation successful
0620 22:06:11.833635 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":98,"thread_start_us":69,"threads_started":1}
I20260620 22:06:11.834250 14710 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:06:11.834632 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.834506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:59956)
0620 22:06:11.834567 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.834611 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260620 22:06:11.834784 14660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
I20260620 22:06:11.835188 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.835081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:59968)
0620 22:06:11.835132 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.835161 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260620 22:06:11.835317 14710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:38651: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab.
Entry for principal kudu/127.1.55.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab.
I20260620 22:06:11.842352 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.252:38651
--webserver_interface=127.1.55.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab
--principal=kudu/127.1.55.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:44585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45631,127.1.55.253:39583,127.1.55.252:38651
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:11.884596 14710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } attempt: 1
I20260620 22:06:11.885027 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.884889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:59972)
0620 22:06:11.884952 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.884994 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260620 22:06:11.885370 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.885294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:59978)
0620 22:06:11.885331 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.885350 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260620 22:06:11.885481 14710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:38651: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
I20260620 22:06:11.891251 14635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } attempt: 3
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:06:11.897703 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.891580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56060 (local address 127.1.55.253:39583)
0620 22:06:11.891644 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.891646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.891657 (+ 11us) server_negotiation.cc:407] Connection header received
0620 22:06:11.891703 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.891704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.891714 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.891788 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.892085 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.892573 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.893260 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.893455 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.893580 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.895508 (+ 1928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:11.895510 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:11.895510 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:11.895515 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:11.896744 (+ 1229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.897097 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.897097 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.897098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.897140 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.897322 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.897323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.897323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.897405 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:11.897448 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:11.897605 (+ 157us) server_negotiation.cc:299] Negotiation successful
0620 22:06:11.897657 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260620 22:06:11.897753 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.891525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:56060)
0620 22:06:11.891566 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.891579 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:11.891648 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:11.891794 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:11.891795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:11.891944 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:11.892003 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.892005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.892664 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.892665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.893162 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.893164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.893580 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.893581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.893664 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.894110 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:11.894121 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:11.895429 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:11.896822 (+ 1393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.896823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.896823 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.897029 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.897199 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.897200 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.897200 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.897268 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.897460 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:11.897460 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:11.897519 (+ 59us) client_negotiation.cc:769] Sending connection context
0620 22:06:11.897590 (+ 71us) client_negotiation.cc:240] Negotiation successful
0620 22:06:11.897672 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260620 22:06:11.898125 14635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:06:11.898432 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.898337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:59984)
0620 22:06:11.898383 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.898412 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260620 22:06:11.898792 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.898697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:59988)
0620 22:06:11.898741 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.898772 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260620 22:06:11.898901 14635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:38651: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
W20260620 22:06:11.920514 14717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:11.920683 14717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:11.920703 14717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:11.921675 14717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:11.921705 14717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:11.921718 14717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:11.921729 14717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:11.921741 14717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:11.922971 14717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:44585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45631,127.1.55.253:39583,127.1.55.252:38651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab
--principal=kudu/127.1.55.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.252:38651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.55.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:11.923125 14717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:11.923264 14717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:11.927417 14723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:11.927394 14725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:11.927421 14722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:11.927706 14717 server_base.cc:1034] running on GCE node
I20260620 22:06:11.927958 14717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:11.928228 14717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:11.929387 14717 hybrid_clock.cc:648] HybridClock initialized: now 1781993171929365 us; error 32 us; skew 500 ppm
I20260620 22:06:11.930024 14635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } attempt: 1
I20260620 22:06:11.930374 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.930275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:60004)
0620 22:06:11.930325 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.930353 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260620 22:06:11.930709 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.930602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:60016)
0620 22:06:11.930646 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.930694 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260620 22:06:11.930790 14635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:38651: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:11.931815 14717 init.cc:377] Logged in from keytab as kudu/127.1.55.252@KRBTEST.COM (short username kudu)
I20260620 22:06:11.932199 14717 webserver.cc:460] Webserver started at http://127.1.55.252:34963/ using document root <none> and password file <none>
I20260620 22:06:11.932418 14717 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:11.932477 14717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:11.932607 14717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:11.933590 14717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/data/instance:
uuid: "f1190c4047c3425482505f812808816b"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "363b804d1b3b98dff8754feee0bbca89"
server_key_iv: "82a91cc95d188e6dfe5476c75eb51e2a"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.933920 14717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/wal/instance:
uuid: "f1190c4047c3425482505f812808816b"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "363b804d1b3b98dff8754feee0bbca89"
server_key_iv: "82a91cc95d188e6dfe5476c75eb51e2a"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.935091 14717 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:11.935681 14732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:11.935843 14717 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:11.935946 14717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/wal
uuid: "f1190c4047c3425482505f812808816b"
format_stamp: "Formatted at 2026-06-20 22:06:11 on dist-test-slave-xw35"
server_key: "363b804d1b3b98dff8754feee0bbca89"
server_key_iv: "82a91cc95d188e6dfe5476c75eb51e2a"
server_key_version: "encryptionkey@0"
I20260620 22:06:11.936009 14717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:11.953627 14710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } attempt: 2
I20260620 22:06:11.953972 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.953847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:60020)
0620 22:06:11.953917 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.953949 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260620 22:06:11.954320 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.954239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:60026)
0620 22:06:11.954280 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.954303 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260620 22:06:11.954421 14710 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:38651: Network error: Client connection negotiation failed: client connection to 127.1.55.252:38651: connect: Connection refused (error 111)
I20260620 22:06:11.973793 14717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:11.975488 14717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:11.975582 14717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:11.979112 14717 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.252:38651
I20260620 22:06:11.979162 14784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.252:38651 every 8 connection(s)
I20260620 22:06:11.979477 14717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
I20260620 22:06:11.980294 14785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:11.981727 14785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:06:11.986610 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 14717
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:11.986719 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781993001979103-1247-0/minicluster-data/master-2/wal/instance
I20260620 22:06:11.986907 1247 external_mini_cluster.cc:1428] Setting key 1c11aa673111b2f5d25f65c4ca91e0a3
I20260620 22:06:11.989930 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.982298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42116 (local address 127.1.55.254:45631)
0620 22:06:11.982355 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.982357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.982539 (+ 182us) server_negotiation.cc:407] Connection header received
0620 22:06:11.982927 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.982928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.982936 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.982976 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.983489 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.983923 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.984871 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.985037 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.985085 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.987152 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:11.987154 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:11.987154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:11.987161 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:11.988583 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.988993 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.988994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.988995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.989051 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.989295 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.989296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.989296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.989404 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:11.989475 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:11.989786 (+ 311us) server_negotiation.cc:299] Negotiation successful
0620 22:06:11.989855 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:06:11.990100 14787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.982291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45631 (local address 127.0.0.1:42116)
0620 22:06:11.982443 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.982472 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:11.982857 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:11.983026 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:11.983029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:11.983261 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:11.983427 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.983430 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.984001 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.984002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.984804 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.984806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.985104 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.985105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.985195 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.985732 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:11.985739 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:11.987065 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:11.988684 (+ 1619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.988691 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.988692 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.988907 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.989116 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.989117 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.989117 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.989226 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.989503 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:11.989509 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:11.989629 (+ 120us) client_negotiation.cc:769] Sending connection context
0620 22:06:11.989760 (+ 131us) client_negotiation.cc:240] Negotiation successful
0620 22:06:11.989891 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260620 22:06:11.990871 14785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:06:11.994901 14789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.987243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60028 (local address 127.1.55.252:38651)
0620 22:06:11.987377 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.987381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.987400 (+ 19us) server_negotiation.cc:407] Connection header received
0620 22:06:11.987465 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.987467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.987479 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.987541 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.988151 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.988808 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.989579 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.989879 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.989960 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.992255 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:11.992260 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:11.992261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:11.992266 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:11.993689 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.994040 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.994043 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.994043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.994095 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.994359 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.994360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.994360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.994483 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:11.994627 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:11.994699 (+ 72us) server_negotiation.cc:299] Negotiation successful
0620 22:06:11.994790 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260620 22:06:11.997263 14787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.991082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39583 (local address 127.0.0.1:56072)
0620 22:06:11.991130 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.991139 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:11.991175 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:11.991311 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:11.991312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:11.991444 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:11.991506 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.991507 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.992111 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.992112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.992777 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.992779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.993233 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.993234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.993287 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.993648 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:11.993653 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:11.994754 (+ 1101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:11.996344 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.996345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.996345 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.996501 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.996706 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:11.996706 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:11.996707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:11.996758 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:11.997006 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:11.997007 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:11.997042 (+ 35us) client_negotiation.cc:769] Sending connection context
0620 22:06:11.997104 (+ 62us) client_negotiation.cc:240] Negotiation successful
0620 22:06:11.997178 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260620 22:06:11.997277 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.991128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56072 (local address 127.1.55.253:39583)
0620 22:06:11.991201 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.991203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.991211 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:11.991233 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.991234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.991244 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.991296 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.991585 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.992040 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.992851 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.993144 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.993229 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.994831 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:11.994832 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:11.994833 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:11.994839 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:11.996227 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.996583 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.996584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.996584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.996634 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:11.996834 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:11.996835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:11.996835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:11.996947 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:11.997012 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:11.997143 (+ 131us) server_negotiation.cc:299] Negotiation successful
0620 22:06:11.997205 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260620 22:06:11.997721 14785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
Jun 20 22:06:11 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:06:12.002661 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.995799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42128 (local address 127.1.55.254:45631)
0620 22:06:11.995834 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.995836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.995841 (+ 5us) server_negotiation.cc:407] Connection header received
0620 22:06:11.995856 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.995857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.995865 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.995926 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.996404 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.996814 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.997514 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.997760 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.997826 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:11.999947 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:11.999948 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:11.999949 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:11.999955 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:12.001622 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.001948 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.001949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.001949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.001999 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.002195 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.002196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.002197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.002310 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:12.002481 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:12.002514 (+ 33us) server_negotiation.cc:299] Negotiation successful
0620 22:06:12.002576 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:06:12.004304 14787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.997922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:60040)
0620 22:06:11.997969 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:11.997978 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:11.998021 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:11.998210 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:11.998211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:11.998344 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:11.998376 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.998377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.998964 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.998966 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.999511 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:11.999513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.999899 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.999899 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:11.999946 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.000331 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:12.000335 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:12.001666 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:12.003284 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:12.003284 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:12.003285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:12.003509 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:12.003714 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:12.003715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:12.003715 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:12.003768 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:12.004033 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:12.004033 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:12.004074 (+ 41us) client_negotiation.cc:769] Sending connection context
0620 22:06:12.004115 (+ 41us) client_negotiation.cc:240] Negotiation successful
0620 22:06:12.004223 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260620 22:06:12.004354 14789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:11.997956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60040 (local address 127.1.55.252:38651)
0620 22:06:11.997983 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:11.997984 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:11.998086 (+ 102us) server_negotiation.cc:407] Connection header received
0620 22:06:11.998100 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:11.998100 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:11.998108 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:11.998164 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:11.998449 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.998888 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.999606 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:11.999819 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:11.999898 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.001780 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:12.001781 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:12.001781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:12.001787 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:12.003195 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.003582 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.003583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.003583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.003641 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.003829 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.003830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.003830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.003966 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:12.004056 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:12.004141 (+ 85us) server_negotiation.cc:299] Negotiation successful
0620 22:06:12.004275 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":13}
I20260620 22:06:12.005959 14785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b: Bootstrap starting.
I20260620 22:06:12.005949 14635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } attempt: 2
I20260620 22:06:12.006963 14785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:12.007243 14785 log.cc:824] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b: Log is configured to *not* fsync() on all Append() calls
Jun 20 22:06:12 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:06:12.007992 14785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b: No bootstrap required, opened a new log
I20260620 22:06:12.009984 14785 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.010114 14785 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:12.010171 14785 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1190c4047c3425482505f812808816b, State: Initialized, Role: FOLLOWER
Jun 20 22:06:12 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:06:12.010291 14785 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.010640 14785 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:12.012142 14791 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.012234 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:12.003479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56084 (local address 127.1.55.253:39583)
0620 22:06:12.003513 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:12.003515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:12.003525 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:06:12.003561 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:12.003562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:12.003570 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:12.003615 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:12.004189 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.004757 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.005378 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.005646 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.005725 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.008065 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:12.008067 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:12.008067 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:12.008073 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:12.010412 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.010807 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.010808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.010810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.010877 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.011393 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.011394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.011394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.011818 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:12.012002 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:12.012046 (+ 44us) server_negotiation.cc:299] Negotiation successful
0620 22:06:12.012126 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:06:12.012293 14791 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: This master's current role is: FOLLOWER
W20260620 22:06:12.012882 14802 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:06:12.012996 14802 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:06:12.013456 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:12.006157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:60050)
0620 22:06:12.006204 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:12.006215 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:12.006263 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:12.006386 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:12.006387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:12.006538 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:12.006580 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:12.006581 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.007364 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.007365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:12.008148 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:12.008151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.008606 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.008607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:12.008667 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.009170 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:12.009174 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:12.010554 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:12.012407 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:12.012407 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:12.012408 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:12.012607 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:12.012815 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:12.012816 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:12.012816 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:12.012880 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:12.013187 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:12.013188 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:12.013226 (+ 38us) client_negotiation.cc:769] Sending connection context
0620 22:06:12.013286 (+ 60us) client_negotiation.cc:240] Negotiation successful
0620 22:06:12.013368 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260620 22:06:12.013665 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:06:12.013973 14789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:12.006219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60050 (local address 127.1.55.252:38651)
0620 22:06:12.006253 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:12.006255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:12.006268 (+ 13us) server_negotiation.cc:407] Connection header received
0620 22:06:12.006319 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:12.006320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:12.006329 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:12.006384 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:12.006654 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.007254 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.008233 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.008516 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.008589 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.010637 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:12.010639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:12.010639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:12.010645 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:12.012328 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.012682 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.012683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.012683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.012733 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.012965 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.012966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.012967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.013101 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:12.013159 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:12.013812 (+ 653us) server_negotiation.cc:299] Negotiation successful
0620 22:06:12.013890 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:06:12.015486 14635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2: Bootstrap starting.
I20260620 22:06:12.013654 14717 master_runner.cc:186] Error getting master registration for 127.1.55.254:45631: OK, instance_id { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" instance_seqno: 1781993171666593 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 22:06:12.015995 14717 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 22:06:12.016109 14635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:12.016388 14635 log.cc:824] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:12.017413 14635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2: No bootstrap required, opened a new log
I20260620 22:06:12.019321 14635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.019434 14635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:12.019467 14635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ddb79688ab437283a64bf7833ce2e2, State: Initialized, Role: FOLLOWER
I20260620 22:06:12.019660 14635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.019996 14635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:12.023814 14789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:12.016825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60060 (local address 127.1.55.252:38651)
0620 22:06:12.016984 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:12.016985 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:12.016992 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:06:12.017009 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:12.017009 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:12.017017 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:12.017075 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:12.017754 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.018366 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.019345 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.019685 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.019739 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.021133 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:12.021134 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:12.021134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:12.021140 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:12.022719 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.023090 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.023091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.023091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.023136 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.023318 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.023318 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.023319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.023418 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:12.023478 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:12.023655 (+ 177us) server_negotiation.cc:299] Negotiation successful
0620 22:06:12.023737 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260620 22:06:12.022691 14567 master_runner.cc:186] Error getting master registration for 127.1.55.253:39583: OK, instance_id { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" instance_seqno: 1781993171813029 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260620 22:06:12.025382 14823 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260620 22:06:12.025408 14567 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 22:06:12.025422 14823 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:06:12.027887 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:12.015512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56094 (local address 127.1.55.253:39583)
0620 22:06:12.015543 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:12.015545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:12.015969 (+ 424us) server_negotiation.cc:407] Connection header received
0620 22:06:12.016054 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:12.016054 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:12.016063 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:12.016088 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:12.016653 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.017232 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.018238 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.018490 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.018523 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.019972 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:12.019973 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:12.019974 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:12.019980 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:12.022393 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.026815 (+ 4422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.026816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.026816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.026874 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.027289 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.027290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.027291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.027413 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:12.027501 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:12.027726 (+ 225us) server_negotiation.cc:299] Negotiation successful
0620 22:06:12.027802 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:06:12.029036 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:12.015290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42130 (local address 127.1.55.254:45631)
0620 22:06:12.016644 (+ 1354us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:12.016646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:12.016653 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:06:12.016671 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:12.016672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:12.016679 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:12.016735 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:12.022466 (+ 5731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.023116 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.024179 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.024444 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.024482 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.026280 (+ 1798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:12.026281 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:12.026281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:12.026300 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:12.027863 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.028225 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.028226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.028227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.028275 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.028462 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.028463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.028463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.028576 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:12.028657 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:12.028879 (+ 222us) server_negotiation.cc:299] Negotiation successful
0620 22:06:12.028949 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1337}
I20260620 22:06:12.029407 14812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.029657 14812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:06:12.045537 14710 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } attempt: 3
Jun 20 22:06:12 dist-test-slave-xw35 krb5kdc[14554](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993171, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:06:12.053321 14712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:12.045776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:38651 (local address 127.0.0.1:60074)
0620 22:06:12.045816 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:12.045825 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:12.045872 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:12.046018 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:12.046019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:12.046167 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:12.046216 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:12.046217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.047029 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.047030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:12.047836 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:12.047839 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.048295 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.048296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:12.048350 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.048772 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:12.048777 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:12.050498 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:12.052247 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:12.052248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:12.052249 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:12.052479 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:12.052684 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:12.052685 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:12.052685 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:12.052749 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:12.053022 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:12.053023 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:12.053063 (+ 40us) client_negotiation.cc:769] Sending connection context
0620 22:06:12.053132 (+ 69us) client_negotiation.cc:240] Negotiation successful
0620 22:06:12.053233 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260620 22:06:12.053323 14789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:12.045830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60074 (local address 127.1.55.252:38651)
0620 22:06:12.045865 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:12.045867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:12.045875 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:12.045932 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:12.045933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:12.045941 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:12.046001 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:12.046284 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.046969 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.047911 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:12.048215 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:12.048287 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:12.050595 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:12.050596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:12.050596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:12.050603 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:12.052164 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.052557 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.052558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.052558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.052612 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:12.052816 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:12.052817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:12.052817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:12.052939 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:12.053018 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:12.053167 (+ 149us) server_negotiation.cc:299] Negotiation successful
0620 22:06:12.053245 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:06:12.055023 14710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: Bootstrap starting.
I20260620 22:06:12.055660 14710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:12.055940 14710 log.cc:824] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:12.056757 14710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: No bootstrap required, opened a new log
I20260620 22:06:12.058667 14710 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.058799 14710 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:12.058832 14710 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a4a5bbd033942ccaa4429a9b700a333, State: Initialized, Role: FOLLOWER
I20260620 22:06:12.059242 14710 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.059540 14710 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [sys.catalog]: configured and running, proceeding with master startup.
W20260620 22:06:12.061049 14663 tablet.cc:2369] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:06:12.061580 14837 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:06:12.061681 14837 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:06:12.063144 14642 master_runner.cc:263] No leader master found from master 5a4a5bbd033942ccaa4429a9b700a333
I20260620 22:06:12.063187 14642 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 22:06:12.063385 14826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.063510 14826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:06:12.115724 14791 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:12.115814 14791 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.115994 14791 leader_election.cc:288] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43ddb79688ab437283a64bf7833ce2e2 (127.1.55.254:45631), 5a4a5bbd033942ccaa4429a9b700a333 (127.1.55.253:39583)
I20260620 22:06:12.116397 14684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1190c4047c3425482505f812808816b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a4a5bbd033942ccaa4429a9b700a333" is_pre_election: true
I20260620 22:06:12.116514 14684 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1190c4047c3425482505f812808816b in term 0.
I20260620 22:06:12.116793 14734 leader_election.cc:302] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a4a5bbd033942ccaa4429a9b700a333, f1190c4047c3425482505f812808816b; no voters:
I20260620 22:06:12.116962 14791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:06:12.117017 14791 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:06:12.117036 14791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:12.117880 14791 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.117981 14791 leader_election.cc:288] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [CANDIDATE]: Term 1 election: Requested vote from peers 43ddb79688ab437283a64bf7833ce2e2 (127.1.55.254:45631), 5a4a5bbd033942ccaa4429a9b700a333 (127.1.55.253:39583)
I20260620 22:06:12.118245 14684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1190c4047c3425482505f812808816b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a4a5bbd033942ccaa4429a9b700a333"
I20260620 22:06:12.118304 14684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:12.119110 14684 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1190c4047c3425482505f812808816b in term 1.
I20260620 22:06:12.119304 14734 leader_election.cc:302] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a4a5bbd033942ccaa4429a9b700a333, f1190c4047c3425482505f812808816b; no voters:
I20260620 22:06:12.119624 14609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1190c4047c3425482505f812808816b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ddb79688ab437283a64bf7833ce2e2" is_pre_election: true
I20260620 22:06:12.119810 14609 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1190c4047c3425482505f812808816b in term 0.
I20260620 22:06:12.119907 14608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1190c4047c3425482505f812808816b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43ddb79688ab437283a64bf7833ce2e2"
I20260620 22:06:12.119976 14608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:12.120746 14608 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1190c4047c3425482505f812808816b in term 1.
I20260620 22:06:12.121878 14791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:12.121999 14791 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [term 1 LEADER]: Becoming Leader. State: Replica: f1190c4047c3425482505f812808816b, State: Running, Role: LEADER
I20260620 22:06:12.122089 14791 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } }
I20260620 22:06:12.122419 14791 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1190c4047c3425482505f812808816b. Latest consensus state: current_term: 1 leader_uuid: "f1190c4047c3425482505f812808816b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.122483 14791 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:12.122784 14841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:12.123003 14841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:06:12.124833 14684 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [term 1 FOLLOWER]: Refusing update from remote peer f1190c4047c3425482505f812808816b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:12.125180 14791 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:12.126390 14826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1190c4047c3425482505f812808816b. Latest consensus state: current_term: 1 leader_uuid: "f1190c4047c3425482505f812808816b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.126463 14826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:06:12.126817 14608 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [term 1 FOLLOWER]: Refusing update from remote peer f1190c4047c3425482505f812808816b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:12.127060 14791 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [LEADER]: Connected to new peer: Peer: permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:12.128093 14812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1190c4047c3425482505f812808816b. Latest consensus state: current_term: 1 leader_uuid: "f1190c4047c3425482505f812808816b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.128190 14812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:06:12.129067 14791 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f1190c4047c3425482505f812808816b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.129139 14791 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:12.129521 14812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f1190c4047c3425482505f812808816b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.129595 14812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:06:12.129868 14842 mvcc.cc:205] Tried to move back new op lower bound from 7299044033021476864 to 7299044033012543488. Current Snapshot: MvccSnapshot[applied={T|T < 7299044033021476864}]
I20260620 22:06:12.130352 14845 mvcc.cc:205] Tried to move back new op lower bound from 7299044033021476864 to 7299044033012543488. Current Snapshot: MvccSnapshot[applied={T|T < 7299044033021476864}]
I20260620 22:06:12.131103 14791 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f1190c4047c3425482505f812808816b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.131173 14791 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:12.131511 14826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f1190c4047c3425482505f812808816b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "43ddb79688ab437283a64bf7833ce2e2" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45631 } } peers { permanent_uuid: "5a4a5bbd033942ccaa4429a9b700a333" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39583 } } peers { permanent_uuid: "f1190c4047c3425482505f812808816b" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 38651 } } }
I20260620 22:06:12.131588 14826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:06:12.132185 14843 mvcc.cc:205] Tried to move back new op lower bound from 7299044033021476864 to 7299044033012543488. Current Snapshot: MvccSnapshot[applied={T|T < 7299044033021476864}]
I20260620 22:06:12.132640 14841 catalog_manager.cc:1347] Generated new cluster ID: d904948c3cdf4bfbaa23f1d7b280364f
I20260620 22:06:12.132682 14841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:06:12.165548 14841 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:06:12.166276 14841 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:06:12.173107 14841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1190c4047c3425482505f812808816b: Generated new TSK 0
I20260620 22:06:12.173257 14841 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:06:13.026589 14823 catalog_manager.cc:1259] Loaded cluster ID: d904948c3cdf4bfbaa23f1d7b280364f
I20260620 22:06:13.026652 14823 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2: loading cluster ID for follower catalog manager: success
I20260620 22:06:13.027345 14823 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2: acquiring CA information for follower catalog manager: success
I20260620 22:06:13.027603 14823 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 43ddb79688ab437283a64bf7833ce2e2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 22:06:13.062059 14837 catalog_manager.cc:1259] Loaded cluster ID: d904948c3cdf4bfbaa23f1d7b280364f
I20260620 22:06:13.062155 14837 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: loading cluster ID for follower catalog manager: success
I20260620 22:06:13.062872 14837 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: acquiring CA information for follower catalog manager: success
I20260620 22:06:13.063127 14837 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5a4a5bbd033942ccaa4429a9b700a333: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 22:06:13.230667 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 14567
I20260620 22:06:13.235795 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 14642
I20260620 22:06:13.240595 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 14717
2026-06-20T22:06:13Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2785 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:06:13 dist-test-slave-xw35 krb5kdc[14856](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:06:13 dist-test-slave-xw35 krb5kdc[14856](info): set up 2 sockets
Jun 20 22:06:13 dist-test-slave-xw35 krb5kdc[14856](info): commencing operation
krb5kdc: starting...
W20260620 22:06:14.233198 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.974s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:06:14 dist-test-slave-xw35 krb5kdc[14856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:06:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:06:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:06:14.333850 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45701
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:14.407868 14869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:14.408041 14869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:14.408061 14869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:14.409192 14869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:14.409233 14869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:14.409247 14869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:14.409260 14869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:14.409314 14869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:14.410696 14869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:14.410943 14869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:14.411161 14869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:14.415542 14874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:14.415699 14875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:14.415653 14869 server_base.cc:1034] running on GCE node
W20260620 22:06:14.415566 14877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:14.416018 14869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:14.416242 14869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:14.417392 14869 hybrid_clock.cc:648] HybridClock initialized: now 1781993174417382 us; error 26 us; skew 500 ppm
Jun 20 22:06:14 dist-test-slave-xw35 krb5kdc[14856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993174, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:14.423449 14869 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:14.423803 14869 webserver.cc:460] Webserver started at http://127.1.55.254:39539/ using document root <none> and password file <none>
I20260620 22:06:14.423957 14869 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:14.423995 14869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:14.424070 14869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:14.424929 14869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "e5ce4f615dff42e2b5e1bcc22248027b"
format_stamp: "Formatted at 2026-06-20 22:06:14 on dist-test-slave-xw35"
server_key: "1aed90f4cb426a19abcdd4a99adbcc2f"
server_key_iv: "a0672882cdb24707e55969bda3e8c0e5"
server_key_version: "encryptionkey@0"
I20260620 22:06:14.425194 14869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "e5ce4f615dff42e2b5e1bcc22248027b"
format_stamp: "Formatted at 2026-06-20 22:06:14 on dist-test-slave-xw35"
server_key: "1aed90f4cb426a19abcdd4a99adbcc2f"
server_key_iv: "a0672882cdb24707e55969bda3e8c0e5"
server_key_version: "encryptionkey@0"
I20260620 22:06:14.426415 14869 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:06:14.427076 14884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:14.427238 14869 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:06:14.427326 14869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "e5ce4f615dff42e2b5e1bcc22248027b"
format_stamp: "Formatted at 2026-06-20 22:06:14 on dist-test-slave-xw35"
server_key: "1aed90f4cb426a19abcdd4a99adbcc2f"
server_key_iv: "a0672882cdb24707e55969bda3e8c0e5"
server_key_version: "encryptionkey@0"
I20260620 22:06:14.427394 14869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:14.441653 14869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:14.443209 14869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:14.443372 14869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:14.446892 14869 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:45701
I20260620 22:06:14.446945 14936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:45701 every 8 connection(s)
I20260620 22:06:14.447237 14869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:14.448061 14937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:14.450158 14937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b: Bootstrap starting.
I20260620 22:06:14.450704 14937 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:14.450984 14937 log.cc:824] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:14.451615 14937 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b: No bootstrap required, opened a new log
I20260620 22:06:14.452984 14937 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ce4f615dff42e2b5e1bcc22248027b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45701 } }
I20260620 22:06:14.453100 14937 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:14.453120 14937 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ce4f615dff42e2b5e1bcc22248027b, State: Initialized, Role: FOLLOWER
I20260620 22:06:14.453275 14937 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ce4f615dff42e2b5e1bcc22248027b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45701 } }
I20260620 22:06:14.453354 14937 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:06:14.453377 14937 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:06:14.453433 14937 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:14.453974 14937 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ce4f615dff42e2b5e1bcc22248027b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45701 } }
I20260620 22:06:14.454082 14937 leader_election.cc:302] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5ce4f615dff42e2b5e1bcc22248027b; no voters:
I20260620 22:06:14.454231 14937 leader_election.cc:288] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:06:14.454267 14940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:14.454413 14940 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [term 1 LEADER]: Becoming Leader. State: Replica: e5ce4f615dff42e2b5e1bcc22248027b, State: Running, Role: LEADER
I20260620 22:06:14.454458 14937 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:14.454537 14940 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ce4f615dff42e2b5e1bcc22248027b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45701 } }
I20260620 22:06:14.454897 14942 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5ce4f615dff42e2b5e1bcc22248027b. Latest consensus state: current_term: 1 leader_uuid: "e5ce4f615dff42e2b5e1bcc22248027b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ce4f615dff42e2b5e1bcc22248027b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45701 } } }
I20260620 22:06:14.454979 14942 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:14.454998 14941 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5ce4f615dff42e2b5e1bcc22248027b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ce4f615dff42e2b5e1bcc22248027b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45701 } } }
I20260620 22:06:14.455044 14941 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:14.455173 14948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:14.455658 14948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:06:14.457098 14948 catalog_manager.cc:1347] Generated new cluster ID: 32961cd81f3b469aace8b2a248e64850
I20260620 22:06:14.457154 14948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:06:14.457316 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 14869
I20260620 22:06:14.457407 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:06:14.457617 1247 external_mini_cluster.cc:1428] Setting key 30c7badee168403381e7fe83b0f1e605
Jun 20 22:06:14 dist-test-slave-xw35 krb5kdc[14856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:14.468209 14960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:14.458146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40218 (local address 127.1.55.254:45701)
0620 22:06:14.458292 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:14.458299 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:14.458325 (+ 26us) server_negotiation.cc:407] Connection header received
0620 22:06:14.458429 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:14.458435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:14.458483 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:14.458614 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:14.459323 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:14.460684 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:14.461690 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:14.462379 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:14.462487 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:14.464892 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:14.464896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:14.464896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:14.464907 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:14.466670 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:14.467022 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:14.467025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:14.467025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:14.467120 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:14.467305 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:14.467306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:14.467306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:14.467579 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:14.467712 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:14.467847 (+ 135us) server_negotiation.cc:299] Negotiation successful
0620 22:06:14.467994 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":89,"threads_started":1}
I20260620 22:06:14.468568 14948 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:06:14.469084 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:06:14.469322 14948 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:06:14.474584 14948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5ce4f615dff42e2b5e1bcc22248027b: Generated new TSK 0
I20260620 22:06:14.474721 14948 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:06:14.522784 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 14869
2026-06-20T22:06:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1281 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:06:14 dist-test-slave-xw35 krb5kdc[14964](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:06:14 dist-test-slave-xw35 krb5kdc[14964](info): set up 2 sockets
Jun 20 22:06:14 dist-test-slave-xw35 krb5kdc[14964](info): commencing operation
krb5kdc: starting...
W20260620 22:06:15.497228 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.956s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:06:15 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:06:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:06:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:06:15.603885 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38163
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38163
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:15.677729 14977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:15.677883 14977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:15.677902 14977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:15.678962 14977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:15.679000 14977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:15.679014 14977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:15.679026 14977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:15.679076 14977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:15.680474 14977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:15.680706 14977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:15.680900 14977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:15.685283 14982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:15.685318 14983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:15.685300 14985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:15.685355 14977 server_base.cc:1034] running on GCE node
I20260620 22:06:15.685695 14977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:15.685959 14977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:15.687127 14977 hybrid_clock.cc:648] HybridClock initialized: now 1781993175687132 us; error 46 us; skew 500 ppm
Jun 20 22:06:15 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993175, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:15.689451 14977 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:15.689920 14977 webserver.cc:460] Webserver started at http://127.1.55.254:40957/ using document root <none> and password file <none>
I20260620 22:06:15.690152 14977 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:15.690214 14977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:15.690348 14977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:15.691241 14977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "a55662a778ac4f0a81441ea804f34f9f"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "8260bc005be8929938f9a04f6f0a040d"
server_key_iv: "6e43c783e6d0e8476fd796e2d473c011"
server_key_version: "encryptionkey@0"
I20260620 22:06:15.691576 14977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "a55662a778ac4f0a81441ea804f34f9f"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "8260bc005be8929938f9a04f6f0a040d"
server_key_iv: "6e43c783e6d0e8476fd796e2d473c011"
server_key_version: "encryptionkey@0"
I20260620 22:06:15.692783 14977 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:06:15.693419 14992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:15.693643 14977 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:15.693737 14977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "a55662a778ac4f0a81441ea804f34f9f"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "8260bc005be8929938f9a04f6f0a040d"
server_key_iv: "6e43c783e6d0e8476fd796e2d473c011"
server_key_version: "encryptionkey@0"
I20260620 22:06:15.693831 14977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:15.709370 14977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:15.711452 14977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:15.711596 14977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:15.715276 14977 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:38163
I20260620 22:06:15.715298 15044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:38163 every 8 connection(s)
I20260620 22:06:15.715584 14977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:15.716415 15045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:15.717345 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 14977
I20260620 22:06:15.717446 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:06:15.717623 1247 external_mini_cluster.cc:1428] Setting key a84a962a71c2b8b312d38a6545202e27
I20260620 22:06:15.718647 15045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Bootstrap starting.
I20260620 22:06:15.719229 15045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:15.719555 15045 log.cc:824] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:15.720253 15045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: No bootstrap required, opened a new log
I20260620 22:06:15.722332 15045 raft_consensus.cc:348] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:15.722447 15045 raft_consensus.cc:374] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:15.722467 15045 raft_consensus.cc:729] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a55662a778ac4f0a81441ea804f34f9f, State: Initialized, Role: FOLLOWER
I20260620 22:06:15.722605 15045 consensus_queue.cc:260] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:15.722700 15045 raft_consensus.cc:388] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:06:15.722743 15045 raft_consensus.cc:482] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:06:15.722796 15045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:15.723489 15045 raft_consensus.cc:504] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:15.723598 15045 leader_election.cc:302] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a55662a778ac4f0a81441ea804f34f9f; no voters:
I20260620 22:06:15.723768 15045 leader_election.cc:288] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:06:15.723800 15050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:15.723955 15050 raft_consensus.cc:686] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 1 LEADER]: Becoming Leader. State: Replica: a55662a778ac4f0a81441ea804f34f9f, State: Running, Role: LEADER
I20260620 22:06:15.724025 15045 sys_catalog.cc:564] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:15.724040 15050 consensus_queue.cc:237] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
Jun 20 22:06:15 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:15.724308 15050 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a55662a778ac4f0a81441ea804f34f9f. Latest consensus state: current_term: 1 leader_uuid: "a55662a778ac4f0a81441ea804f34f9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } } }
I20260620 22:06:15.724316 15052 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a55662a778ac4f0a81441ea804f34f9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } } }
I20260620 22:06:15.724380 15050 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:15.724386 15052 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:15.725126 15055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:15.725600 15055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:06:15.727317 15055 catalog_manager.cc:1347] Generated new cluster ID: 5f602e19a4a5440980988dbc1bc5d18c
I20260620 22:06:15.727363 15055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:06:15.728621 15048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:15.718075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45254 (local address 127.1.55.254:38163)
0620 22:06:15.718268 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:15.718274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:15.718296 (+ 22us) server_negotiation.cc:407] Connection header received
0620 22:06:15.718623 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:15.718628 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:15.718671 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:15.718815 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:15.719450 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:15.720744 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:15.721433 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:15.722102 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:15.722207 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:15.724900 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:15.724903 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:15.724904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:15.724915 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:15.726960 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:15.727374 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:15.727377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:15.727378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:15.727490 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:15.727716 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:15.727717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:15.727718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:15.728014 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:15.728169 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:15.728291 (+ 122us) server_negotiation.cc:299] Negotiation successful
0620 22:06:15.728423 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
I20260620 22:06:15.749229 15055 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:06:15.749734 15055 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:06:15.755695 15055 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Generated new TSK 0
I20260620 22:06:15.755860 15055 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:06:15.784747 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38163
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:15.877137 15071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:15.877331 15071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:15.877353 15071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:15.878476 15071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:15.878515 15071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:15.878539 15071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:06:15.879932 15071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:15.880144 15071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:15.880368 15071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:15.885257 15077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:15.885257 15079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:15.885291 15076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:15.885569 15071 server_base.cc:1034] running on GCE node
I20260620 22:06:15.885744 15071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:15.885984 15071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:15.887130 15071 hybrid_clock.cc:648] HybridClock initialized: now 1781993175887118 us; error 25 us; skew 500 ppm
Jun 20 22:06:15 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993175, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:15.889582 15071 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:06:15.890031 15071 webserver.cc:460] Webserver started at http://127.1.55.193:38655/ using document root <none> and password file <none>
I20260620 22:06:15.890239 15071 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:15.890311 15071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:15.890445 15071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:15.891348 15071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "303c508c792045148b0c5ba47100a302"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "a67320442a32fa1682bdf80ecbb0f7e1"
server_key_iv: "f420ba788e530758eec9e8e69e8e8056"
server_key_version: "encryptionkey@0"
I20260620 22:06:15.891674 15071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "303c508c792045148b0c5ba47100a302"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "a67320442a32fa1682bdf80ecbb0f7e1"
server_key_iv: "f420ba788e530758eec9e8e69e8e8056"
server_key_version: "encryptionkey@0"
I20260620 22:06:15.892956 15071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:06:15.893661 15086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:15.893833 15071 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:15.893906 15071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "303c508c792045148b0c5ba47100a302"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "a67320442a32fa1682bdf80ecbb0f7e1"
server_key_iv: "f420ba788e530758eec9e8e69e8e8056"
server_key_version: "encryptionkey@0"
I20260620 22:06:15.893985 15071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:15.914780 15071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:15.916432 15071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:15.916581 15071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:15.916821 15071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:15.917120 15071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:15.917155 15071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:15.917176 15071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:15.917245 15071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:15.922776 15071 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:37845
I20260620 22:06:15.922827 15199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:37845 every 8 connection(s)
I20260620 22:06:15.923120 15071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
Jun 20 22:06:15 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993175, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:15.929143 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 15071
I20260620 22:06:15.929262 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:06:15.929448 1247 external_mini_cluster.cc:1428] Setting key 8c590a6e0018d03ca897d224e19addcb
I20260620 22:06:15.932147 15048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:15.923728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:50451 (local address 127.1.55.254:38163)
0620 22:06:15.923770 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:15.923772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:15.923992 (+ 220us) server_negotiation.cc:407] Connection header received
0620 22:06:15.924486 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:15.924487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:15.924497 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:15.924545 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:15.925422 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:15.926030 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:15.926874 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:15.927063 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:15.927124 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:15.929100 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:15.929101 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:15.929102 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:15.929108 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:15.930870 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:15.931224 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:15.931225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:15.931226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:15.931287 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:15.931570 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:15.931571 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:15.931572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:15.931693 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:15.931743 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:15.932023 (+ 280us) server_negotiation.cc:299] Negotiation successful
0620 22:06:15.932093 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:06:15.932375 15202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:15.923718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:50451)
0620 22:06:15.923873 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:15.923902 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:15.924412 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:15.924622 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:15.924626 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:15.925114 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:15.925324 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:15.925328 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:15.926103 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:15.926103 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:15.926810 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:15.926811 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:15.927141 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:15.927141 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:15.927233 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:15.927690 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:15.927698 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:15.929007 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:15.930955 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:15.930960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:15.930962 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:15.931150 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:15.931371 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:15.931372 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:15.931372 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:15.931498 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:15.931755 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:15.931761 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:15.931901 (+ 140us) client_negotiation.cc:769] Sending connection context
0620 22:06:15.932005 (+ 104us) client_negotiation.cc:240] Negotiation successful
0620 22:06:15.932155 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
I20260620 22:06:15.932812 15200 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38163
I20260620 22:06:15.932895 15200 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:15.933041 15200 heartbeater.cc:511] Master 127.1.55.254:38163 requested a full tablet report, sending...
I20260620 22:06:15.933512 15009 ts_manager.cc:194] Registered new tserver with Master: 303c508c792045148b0c5ba47100a302 (127.1.55.193:37845)
I20260620 22:06:15.934093 15009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:50451
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:06:15.951294 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38163
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:16.023919 15205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:16.024073 15205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:16.024092 15205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:16.025194 15205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:16.025230 15205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:16.025254 15205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:06:16.026600 15205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:16.026815 15205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:16.027019 15205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:16.031776 15213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.031801 15210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.031822 15205 server_base.cc:1034] running on GCE node
W20260620 22:06:16.031831 15211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.032131 15205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:16.032397 15205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:16.033524 15205 hybrid_clock.cc:648] HybridClock initialized: now 1781993176033500 us; error 32 us; skew 500 ppm
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:16.035749 15205 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:06:16.036154 15205 webserver.cc:460] Webserver started at http://127.1.55.194:33583/ using document root <none> and password file <none>
I20260620 22:06:16.036339 15205 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:16.036375 15205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:16.036450 15205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:16.037317 15205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "084ef22a58274d5db1bfb45d6e455b52"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "d920c84065c9fa4f3e76879d93178ad8"
server_key_iv: "db33d4e7ea31ab94404b3cdadcb1425e"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.037653 15205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "084ef22a58274d5db1bfb45d6e455b52"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "d920c84065c9fa4f3e76879d93178ad8"
server_key_iv: "db33d4e7ea31ab94404b3cdadcb1425e"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.038821 15205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:16.039456 15220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.039610 15205 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:06:16.039690 15205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "084ef22a58274d5db1bfb45d6e455b52"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "d920c84065c9fa4f3e76879d93178ad8"
server_key_iv: "db33d4e7ea31ab94404b3cdadcb1425e"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.039753 15205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:16.049073 15205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:16.051165 15205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:16.051313 15205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:16.051508 15205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:16.051774 15205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:16.051810 15205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.051827 15205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:16.051895 15205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.056991 15205 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:34107
I20260620 22:06:16.057057 15333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:34107 every 8 connection(s)
I20260620 22:06:16.057314 15205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:16.065014 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 15205
I20260620 22:06:16.065145 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:06:16.065351 1247 external_mini_cluster.cc:1428] Setting key f30ae26a4fe3d065145cadb7b93da0f2
I20260620 22:06:16.065809 15048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.058000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:51815 (local address 127.1.55.254:38163)
0620 22:06:16.058061 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.058063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.058225 (+ 162us) server_negotiation.cc:407] Connection header received
0620 22:06:16.058587 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.058587 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.058596 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.058640 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:16.059436 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.059908 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.060849 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.061035 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.061081 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.063024 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:16.063025 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:16.063026 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:16.063032 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:16.064407 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.064729 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.064729 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.064730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.064785 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.065096 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.065096 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.065096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.065264 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:16.065311 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.065631 (+ 320us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.065717 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260620 22:06:16.065907 15336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.057974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:51815)
0620 22:06:16.058108 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.058141 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.058516 (+ 375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.058692 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.058696 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.059186 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:16.059363 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.059367 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.060004 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.060006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.060771 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.060773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.061101 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.061102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.061195 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.061642 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:16.061650 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:16.062946 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:16.064473 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.064478 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.064479 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.064668 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.064864 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.064865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.064866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.065001 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.065310 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:16.065317 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:16.065457 (+ 140us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.065586 (+ 129us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.065720 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260620 22:06:16.066300 15334 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38163
I20260620 22:06:16.066381 15334 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:16.066542 15334 heartbeater.cc:511] Master 127.1.55.254:38163 requested a full tablet report, sending...
I20260620 22:06:16.066835 15009 ts_manager.cc:194] Registered new tserver with Master: 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
I20260620 22:06:16.067193 15009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:51815
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:06:16.085614 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38163
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:16.159463 15339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:16.159638 15339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:16.159660 15339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:16.160661 15339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:16.160693 15339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:16.160717 15339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:06:16.161989 15339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:16.162147 15339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:16.162292 15339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:16.166481 15347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.166491 15345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.166534 15344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.166785 15339 server_base.cc:1034] running on GCE node
I20260620 22:06:16.166952 15339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:16.167176 15339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:16.168304 15339 hybrid_clock.cc:648] HybridClock initialized: now 1781993176168296 us; error 25 us; skew 500 ppm
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:16.170783 15339 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:06:16.171139 15339 webserver.cc:460] Webserver started at http://127.1.55.195:35261/ using document root <none> and password file <none>
I20260620 22:06:16.171339 15339 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:16.171376 15339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:16.171497 15339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:16.172340 15339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "26af8fd170d84daca544bcadca80d259"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "2e98825b258ca5b2a6fbb575c22b0b38"
server_key_iv: "0068be8aedba0db1516df734d6f181a5"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.172642 15339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "26af8fd170d84daca544bcadca80d259"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "2e98825b258ca5b2a6fbb575c22b0b38"
server_key_iv: "0068be8aedba0db1516df734d6f181a5"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.173856 15339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260620 22:06:16.174487 15354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.174640 15339 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.174712 15339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "26af8fd170d84daca544bcadca80d259"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "2e98825b258ca5b2a6fbb575c22b0b38"
server_key_iv: "0068be8aedba0db1516df734d6f181a5"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.174773 15339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:16.186089 15339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:16.188045 15339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:16.188192 15339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:16.188387 15339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:16.188648 15339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:16.188699 15339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.188735 15339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:16.188762 15339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.194103 15339 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:40755
I20260620 22:06:16.194165 15467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:40755 every 8 connection(s)
I20260620 22:06:16.194450 15339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:06:16.199234 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 15339
I20260620 22:06:16.199342 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:06:16.199534 1247 external_mini_cluster.cc:1428] Setting key 04b2a8710fa68f988cd19f5fe8012112
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:16.203169 15048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.195102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:41141 (local address 127.1.55.254:38163)
0620 22:06:16.195175 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.195177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.195331 (+ 154us) server_negotiation.cc:407] Connection header received
0620 22:06:16.195800 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.195801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.195813 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.195880 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:16.196710 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.197332 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.198429 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.198637 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.198730 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.200784 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:16.200786 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:16.200786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:16.200794 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:16.202121 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.202477 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.202478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.202478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.202524 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.202713 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.202713 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.202713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.202807 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:16.202854 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.203058 (+ 204us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.203113 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 22:06:16.203298 15470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.195066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:41141)
0620 22:06:16.195226 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.195262 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.195681 (+ 419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.195943 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.195946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.196441 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:16.196610 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.196613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.197447 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.197448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.198318 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.198320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.198740 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.198740 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.198851 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.199264 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:16.199274 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:16.200687 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:16.202189 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.202195 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.202196 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.202401 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.202577 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.202578 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.202578 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.202662 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.202858 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:16.202861 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:16.202960 (+ 99us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.203033 (+ 73us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.203132 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260620 22:06:16.203665 15468 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38163
I20260620 22:06:16.203742 15468 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:16.203851 15468 heartbeater.cc:511] Master 127.1.55.254:38163 requested a full tablet report, sending...
I20260620 22:06:16.204136 15009 ts_manager.cc:194] Registered new tserver with Master: 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755)
I20260620 22:06:16.204457 15009 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:41141
I20260620 22:06:16.211081 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:06:16.217670 15048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.212361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45264 (local address 127.1.55.254:38163)
0620 22:06:16.212414 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.212416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.212518 (+ 102us) server_negotiation.cc:407] Connection header received
0620 22:06:16.212583 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.212583 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.212592 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.212631 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:16.213167 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.213662 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.214329 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.214510 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.214608 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.215595 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:16.215596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:16.215596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:16.215603 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:16.216577 (+ 974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.216919 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.216920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.216921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.216974 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.217176 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.217177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.217177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.217304 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:16.217400 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.217518 (+ 118us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.217586 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:06:16.218865 15009 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45264:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:06:16.220432 15009 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:06:16.226157 15476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.222244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40755 (local address 127.0.0.1:58078)
0620 22:06:16.222342 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.222376 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.222433 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.222753 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.222755 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.222757 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.222825 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.222826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.223854 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.223855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.225004 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.225006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.225779 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.225780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.225961 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.225971 (+ 10us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.226053 (+ 82us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.226098 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":58,"threads_started":1}
I20260620 22:06:16.226163 15479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.222459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58078 (local address 127.1.55.195:40755)
0620 22:06:16.222593 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.222598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.222607 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:06:16.222641 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.222642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.222656 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.222891 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.222938 (+ 47us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.223753 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.225085 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.225700 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.225776 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.225825 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.226069 (+ 244us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.226101 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260620 22:06:16.226334 15477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.222259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34107 (local address 127.0.0.1:48610)
0620 22:06:16.222382 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.222392 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.222439 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.222945 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.222946 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.222947 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.222989 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.222990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.224248 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.224249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.225343 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.225345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.226137 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.226137 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.226184 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.226186 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.226213 (+ 27us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.226273 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260620 22:06:16.226354 15480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.222472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48812 (local address 127.1.55.193:37845)
0620 22:06:16.222612 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.222617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.222665 (+ 48us) server_negotiation.cc:407] Connection header received
0620 22:06:16.222762 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.222764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.222778 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.222849 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.222990 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.224135 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.225263 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.225955 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.226020 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.226068 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.226252 (+ 184us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.226289 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":68,"threads_started":1}
I20260620 22:06:16.226505 15478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.222277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:37845 (local address 127.0.0.1:48812)
0620 22:06:16.222612 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.222622 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.222676 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.222863 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.222864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.222866 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.222913 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.222914 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.224268 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.224269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.225182 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.225184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.226103 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.226105 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.226163 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.226167 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.226211 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.226448 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":196,"thread_start_us":34,"threads_started":1}
I20260620 22:06:16.226706 15481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.222608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48610 (local address 127.1.55.194:34107)
0620 22:06:16.222754 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.222757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.222765 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:16.222807 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.222809 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.222820 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.222945 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.223069 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.224119 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.225418 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.226058 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.226491 (+ 433us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.226558 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.226584 (+ 26us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.226631 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260620 22:06:16.227092 15402 tablet_service.cc:1467] Processing CreateTablet for tablet 19c9c4d2731140a0a6e09a704d259e59 (DEFAULT_TABLE table=test-table [id=99d8843ebafe43aeb7b174e76b12ff09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:16.227227 15268 tablet_service.cc:1467] Processing CreateTablet for tablet 19c9c4d2731140a0a6e09a704d259e59 (DEFAULT_TABLE table=test-table [id=99d8843ebafe43aeb7b174e76b12ff09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:16.227227 15134 tablet_service.cc:1467] Processing CreateTablet for tablet 19c9c4d2731140a0a6e09a704d259e59 (DEFAULT_TABLE table=test-table [id=99d8843ebafe43aeb7b174e76b12ff09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:16.227372 15402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19c9c4d2731140a0a6e09a704d259e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:16.227509 15268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19c9c4d2731140a0a6e09a704d259e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:16.227509 15134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19c9c4d2731140a0a6e09a704d259e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:16.230587 15483 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Bootstrap starting.
I20260620 22:06:16.230592 15484 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: Bootstrap starting.
I20260620 22:06:16.230880 15482 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: Bootstrap starting.
I20260620 22:06:16.231287 15483 tablet_bootstrap.cc:654] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:16.231328 15484 tablet_bootstrap.cc:654] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:16.231442 15482 tablet_bootstrap.cc:654] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:16.231863 15482 log.cc:824] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:16.231901 15484 log.cc:824] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:16.231901 15483 log.cc:824] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:16.232587 15483 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: No bootstrap required, opened a new log
I20260620 22:06:16.232594 15482 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: No bootstrap required, opened a new log
I20260620 22:06:16.232653 15482 ts_tablet_manager.cc:1397] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:06:16.232653 15483 ts_tablet_manager.cc:1397] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:16.232800 15484 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: No bootstrap required, opened a new log
I20260620 22:06:16.232869 15484 ts_tablet_manager.cc:1397] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:06:16.234163 15484 raft_consensus.cc:348] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.234306 15484 raft_consensus.cc:374] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:16.234349 15484 raft_consensus.cc:729] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 084ef22a58274d5db1bfb45d6e455b52, State: Initialized, Role: FOLLOWER
I20260620 22:06:16.234453 15484 consensus_queue.cc:260] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.234503 15482 raft_consensus.cc:348] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.234522 15483 raft_consensus.cc:348] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.234684 15482 raft_consensus.cc:374] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:16.234684 15483 raft_consensus.cc:374] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:16.234723 15483 raft_consensus.cc:729] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 303c508c792045148b0c5ba47100a302, State: Initialized, Role: FOLLOWER
I20260620 22:06:16.234723 15482 raft_consensus.cc:729] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26af8fd170d84daca544bcadca80d259, State: Initialized, Role: FOLLOWER
I20260620 22:06:16.234738 15484 ts_tablet_manager.cc:1428] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:16.234839 15334 heartbeater.cc:503] Master 127.1.55.254:38163 was elected leader, sending a full tablet report...
I20260620 22:06:16.234820 15482 consensus_queue.cc:260] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.234838 15483 consensus_queue.cc:260] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.235065 15483 ts_tablet_manager.cc:1428] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260620 22:06:16.235065 15482 ts_tablet_manager.cc:1428] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 22:06:16.235064 15468 heartbeater.cc:503] Master 127.1.55.254:38163 was elected leader, sending a full tablet report...
I20260620 22:06:16.235172 15200 heartbeater.cc:503] Master 127.1.55.254:38163 was elected leader, sending a full tablet report...
I20260620 22:06:16.269413 15489 raft_consensus.cc:482] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:16.269518 15489 raft_consensus.cc:504] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.269825 15489 leader_election.cc:288] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107), 303c508c792045148b0c5ba47100a302 (127.1.55.193:37845)
I20260620 22:06:16.272328 15470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.269934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34107 (local address 127.1.55.195:44693)
0620 22:06:16.269978 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.269987 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.270029 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.270181 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.270182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.270183 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.270251 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.270252 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.270891 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.270892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.271571 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.271573 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.272111 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.272112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.272185 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.272188 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.272237 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.272279 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260620 22:06:16.272341 15481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.269976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:44693 (local address 127.1.55.194:34107)
0620 22:06:16.270021 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.270023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.270032 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:06:16.270090 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.270091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.270099 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.270179 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.270353 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.270823 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.271654 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.272044 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.272093 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.272098 (+ 5us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.272254 (+ 156us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.272285 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:06:16.272607 15480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.269994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:44587 (local address 127.1.55.193:37845)
0620 22:06:16.270031 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.270033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.270249 (+ 216us) server_negotiation.cc:407] Connection header received
0620 22:06:16.270272 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.270273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.270284 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.270336 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.270481 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.270902 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.271803 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.272158 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.272225 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.272232 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.272510 (+ 278us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.272546 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:06:16.272614 15491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.269937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:37845 (local address 127.1.55.195:44587)
0620 22:06:16.270165 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.270174 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.270219 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.270355 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.270355 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.270357 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.270417 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.270418 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.270981 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.270982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.271723 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.271725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.272262 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.272263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.272325 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.272329 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.272382 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.272539 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":85,"thread_start_us":94,"threads_started":1}
I20260620 22:06:16.272661 15288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19c9c4d2731140a0a6e09a704d259e59" candidate_uuid: "26af8fd170d84daca544bcadca80d259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "084ef22a58274d5db1bfb45d6e455b52" is_pre_election: true
I20260620 22:06:16.272775 15288 raft_consensus.cc:2454] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26af8fd170d84daca544bcadca80d259 in term 0.
I20260620 22:06:16.272859 15154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19c9c4d2731140a0a6e09a704d259e59" candidate_uuid: "26af8fd170d84daca544bcadca80d259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "303c508c792045148b0c5ba47100a302" is_pre_election: true
I20260620 22:06:16.272961 15358 leader_election.cc:302] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 084ef22a58274d5db1bfb45d6e455b52, 26af8fd170d84daca544bcadca80d259; no voters:
I20260620 22:06:16.272980 15154 raft_consensus.cc:2454] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26af8fd170d84daca544bcadca80d259 in term 0.
I20260620 22:06:16.273056 15489 raft_consensus.cc:2781] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:06:16.273101 15489 raft_consensus.cc:482] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:06:16.273123 15489 raft_consensus.cc:3037] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:16.273695 15489 raft_consensus.cc:504] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.273809 15489 leader_election.cc:288] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [CANDIDATE]: Term 1 election: Requested vote from peers 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107), 303c508c792045148b0c5ba47100a302 (127.1.55.193:37845)
I20260620 22:06:16.273931 15288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19c9c4d2731140a0a6e09a704d259e59" candidate_uuid: "26af8fd170d84daca544bcadca80d259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "084ef22a58274d5db1bfb45d6e455b52"
I20260620 22:06:16.273960 15154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19c9c4d2731140a0a6e09a704d259e59" candidate_uuid: "26af8fd170d84daca544bcadca80d259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "303c508c792045148b0c5ba47100a302"
I20260620 22:06:16.274000 15288 raft_consensus.cc:3037] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:16.274008 15154 raft_consensus.cc:3037] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:16.274685 15154 raft_consensus.cc:2454] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26af8fd170d84daca544bcadca80d259 in term 1.
I20260620 22:06:16.274685 15288 raft_consensus.cc:2454] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26af8fd170d84daca544bcadca80d259 in term 1.
I20260620 22:06:16.274842 15357 leader_election.cc:302] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26af8fd170d84daca544bcadca80d259, 303c508c792045148b0c5ba47100a302; no voters:
I20260620 22:06:16.274925 15489 raft_consensus.cc:2781] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:16.275033 15489 raft_consensus.cc:686] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 1 LEADER]: Becoming Leader. State: Replica: 26af8fd170d84daca544bcadca80d259, State: Running, Role: LEADER
I20260620 22:06:16.275127 15489 consensus_queue.cc:237] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.275766 15008 catalog_manager.cc:5495] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26af8fd170d84daca544bcadca80d259 (127.1.55.195). New cstate: current_term: 1 leader_uuid: "26af8fd170d84daca544bcadca80d259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } health_report { overall_health: UNKNOWN } } }
I20260620 22:06:16.284238 15479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.282258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58088 (local address 127.1.55.195:40755)
0620 22:06:16.282295 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.282296 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.282304 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:16.282370 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.282371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.282382 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.282433 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:06:16.282532 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.282918 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.283612 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.283786 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.283832 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.283928 (+ 96us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:06:16.284011 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:06:16.284054 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.284116 (+ 62us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.284139 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:06:16.285575 15288 raft_consensus.cc:1261] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 1 FOLLOWER]: Refusing update from remote peer 26af8fd170d84daca544bcadca80d259: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:16.285575 15154 raft_consensus.cc:1261] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Refusing update from remote peer 26af8fd170d84daca544bcadca80d259: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:16.285892 15489 consensus_queue.cc:1035] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:16.286016 15492 consensus_queue.cc:1035] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:16.287700 15495 mvcc.cc:205] Tried to move back new op lower bound from 7299044050063478784 to 7299044050023505920. Current Snapshot: MvccSnapshot[applied={T|T < 7299044050063478784}]
I20260620 22:06:16.287971 15496 mvcc.cc:205] Tried to move back new op lower bound from 7299044050063478784 to 7299044050023505920. Current Snapshot: MvccSnapshot[applied={T|T < 7299044050063478784}]
I20260620 22:06:16.288630 15497 mvcc.cc:205] Tried to move back new op lower bound from 7299044050063478784 to 7299044050023505920. Current Snapshot: MvccSnapshot[applied={T|T < 7299044050063478784 or (T in {7299044050063478784})}]
I20260620 22:06:16.289796 15009 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:16.289878 15009 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45264:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:16.290522 15009 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Sending DeleteTablet for 3 replicas of tablet 19c9c4d2731140a0a6e09a704d259e59
I20260620 22:06:16.290782 15402 tablet_service.cc:1514] Processing DeleteTablet for tablet 19c9c4d2731140a0a6e09a704d259e59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:16 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:58078
I20260620 22:06:16.290808 15134 tablet_service.cc:1514] Processing DeleteTablet for tablet 19c9c4d2731140a0a6e09a704d259e59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:16 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:48812
I20260620 22:06:16.290855 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 15071
I20260620 22:06:16.291314 15268 tablet_service.cc:1514] Processing DeleteTablet for tablet 19c9c4d2731140a0a6e09a704d259e59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:16 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:48610
I20260620 22:06:16.291913 15507 tablet_replica.cc:330] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: stopping tablet replica
I20260620 22:06:16.291991 15507 raft_consensus.cc:2229] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:16.292074 15507 raft_consensus.cc:2258] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:16.292277 15505 tablet_replica.cc:330] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: stopping tablet replica
I20260620 22:06:16.292351 15505 raft_consensus.cc:2229] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:06:16.292439 15505 raft_consensus.cc:2258] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:16.292498 15507 ts_tablet_manager.cc:1905] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:16.292793 15505 ts_tablet_manager.cc:1905] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:16.293915 15507 ts_tablet_manager.cc:1918] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:16.293972 15507 log.cc:1196] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/19c9c4d2731140a0a6e09a704d259e59
I20260620 22:06:16.294291 15507 ts_tablet_manager.cc:1939] T 19c9c4d2731140a0a6e09a704d259e59 P 084ef22a58274d5db1bfb45d6e455b52: Deleting consensus metadata
I20260620 22:06:16.294489 15505 ts_tablet_manager.cc:1918] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:16.294543 15505 log.cc:1196] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/19c9c4d2731140a0a6e09a704d259e59
I20260620 22:06:16.294648 14996 catalog_manager.cc:4841] TS 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107): tablet 19c9c4d2731140a0a6e09a704d259e59 (table test-table [id=99d8843ebafe43aeb7b174e76b12ff09]) successfully deleted
I20260620 22:06:16.294757 15505 ts_tablet_manager.cc:1939] T 19c9c4d2731140a0a6e09a704d259e59 P 26af8fd170d84daca544bcadca80d259: Deleting consensus metadata
I20260620 22:06:16.295188 14994 catalog_manager.cc:4841] TS 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755): tablet 19c9c4d2731140a0a6e09a704d259e59 (table test-table [id=99d8843ebafe43aeb7b174e76b12ff09]) successfully deleted
W20260620 22:06:16.296692 14995 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:37845 (error 108)
W20260620 22:06:16.297089 15478 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:06:16.296979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:37845 (local address 127.0.0.1:48816)
0620 22:06:16.297024 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.297057 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:37845: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":29}
W20260620 22:06:16.297185 14995 catalog_manager.cc:4584] TS 303c508c792045148b0c5ba47100a302 (127.1.55.193:37845): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 19c9c4d2731140a0a6e09a704d259e59: Network error: Client connection negotiation failed: client connection to 127.1.55.193:37845: connect: Connection reset by peer (error 104)
I20260620 22:06:16.297281 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 15205
I20260620 22:06:16.303877 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 15339
I20260620 22:06:16.308483 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 14977
I20260620 22:06:16.313256 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38163
--webserver_interface=127.1.55.254
--webserver_port=40957
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:16.386853 15509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:16.387010 15509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:16.387048 15509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:16.388173 15509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:16.388212 15509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:16.388227 15509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:16.388273 15509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:16.388299 15509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:16.389729 15509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=40957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:16.389962 15509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:16.390175 15509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:16.397912 15516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.397921 15515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.397923 15509 server_base.cc:1034] running on GCE node
W20260620 22:06:16.398049 15518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.398365 15509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:16.398685 15509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:16.399852 15509 hybrid_clock.cc:648] HybridClock initialized: now 1781993176399848 us; error 37 us; skew 500 ppm
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:16.402191 15509 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:16.402607 15509 webserver.cc:460] Webserver started at http://127.1.55.254:40957/ using document root <none> and password file <none>
I20260620 22:06:16.402828 15509 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:16.402899 15509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:16.404036 15509 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:16.404614 15525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.404770 15509 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:06:16.404862 15509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "a55662a778ac4f0a81441ea804f34f9f"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "8260bc005be8929938f9a04f6f0a040d"
server_key_iv: "6e43c783e6d0e8476fd796e2d473c011"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.405166 15509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:16.418112 15509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:16.419755 15509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:16.419898 15509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:16.423501 15509 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:38163
I20260620 22:06:16.423527 15577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:38163 every 8 connection(s)
I20260620 22:06:16.423861 15509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:16.425153 15578 sys_catalog.cc:263] Verifying existing consensus state
I20260620 22:06:16.425766 15578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Bootstrap starting.
I20260620 22:06:16.427760 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 15509
I20260620 22:06:16.428051 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:37845
--local_ip_for_outbound_sockets=127.1.55.193
--tserver_master_addrs=127.1.55.254:38163
--webserver_port=38655
--webserver_interface=127.1.55.193
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:16.433396 15578 log.cc:824] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:16.435127 15578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:06:16.435384 15578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Bootstrap complete.
I20260620 22:06:16.437408 15578 raft_consensus.cc:348] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:16.437688 15578 raft_consensus.cc:729] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a55662a778ac4f0a81441ea804f34f9f, State: Initialized, Role: FOLLOWER
I20260620 22:06:16.437848 15578 consensus_queue.cc:260] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:16.437922 15578 raft_consensus.cc:388] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:06:16.437974 15578 raft_consensus.cc:482] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:06:16.438030 15578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 1 FOLLOWER]: Advancing to term 2
I20260620 22:06:16.438992 15578 raft_consensus.cc:504] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:16.439102 15578 leader_election.cc:302] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a55662a778ac4f0a81441ea804f34f9f; no voters:
I20260620 22:06:16.439286 15578 leader_election.cc:288] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260620 22:06:16.439333 15582 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 2 FOLLOWER]: Leader election won for term 2
I20260620 22:06:16.439443 15582 raft_consensus.cc:686] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 2 LEADER]: Becoming Leader. State: Replica: a55662a778ac4f0a81441ea804f34f9f, State: Running, Role: LEADER
I20260620 22:06:16.439534 15578 sys_catalog.cc:564] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:16.439529 15582 consensus_queue.cc:237] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:16.439909 15584 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a55662a778ac4f0a81441ea804f34f9f. Latest consensus state: current_term: 2 leader_uuid: "a55662a778ac4f0a81441ea804f34f9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } } }
I20260620 22:06:16.439985 15584 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:16.440204 15586 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:16.440945 15586 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:06:16.441039 15586 catalog_manager.cc:1259] Loaded cluster ID: 5f602e19a4a5440980988dbc1bc5d18c
I20260620 22:06:16.441068 15586 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:06:16.441315 15583 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a55662a778ac4f0a81441ea804f34f9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } } }
I20260620 22:06:16.441366 15586 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260620 22:06:16.445535 15583 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:16.446440 15586 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260620 22:06:16.448580 15586 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:06:16.448766 15586 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Loaded TSK: 0
I20260620 22:06:16.448985 15586 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 22:06:16.509990 15580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:16.510172 15580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:16.510192 15580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:16.511262 15580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:16.511299 15580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:16.511323 15580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:06:16.512897 15580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:37845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=38655
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:16.513125 15580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:16.513346 15580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:16.517927 15605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.517949 15606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.517904 15608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.518183 15580 server_base.cc:1034] running on GCE node
I20260620 22:06:16.518380 15580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:16.518630 15580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:16.519789 15580 hybrid_clock.cc:648] HybridClock initialized: now 1781993176519771 us; error 35 us; skew 500 ppm
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:16.522128 15580 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:06:16.522538 15580 webserver.cc:460] Webserver started at http://127.1.55.193:38655/ using document root <none> and password file <none>
I20260620 22:06:16.522795 15580 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:16.522848 15580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:16.524061 15580 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:16.524698 15615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.524838 15580 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.524932 15580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "303c508c792045148b0c5ba47100a302"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "a67320442a32fa1682bdf80ecbb0f7e1"
server_key_iv: "f420ba788e530758eec9e8e69e8e8056"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.525213 15580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:16.546092 15580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:16.548090 15580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:16.548229 15580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:16.548475 15580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:16.548923 15622 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 22:06:16.550359 15580 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 22:06:16.550410 15580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260620 22:06:16.550434 15580 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 22:06:16.551049 15580 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 22:06:16.551091 15580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:16.551131 15622 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Bootstrap starting.
I20260620 22:06:16.558518 15580 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:37845
I20260620 22:06:16.558641 15729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:37845 every 8 connection(s)
I20260620 22:06:16.559037 15580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:06:16.562187 15622 log.cc:824] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:16.562492 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 15580
I20260620 22:06:16.562747 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:34107
--local_ip_for_outbound_sockets=127.1.55.194
--tserver_master_addrs=127.1.55.254:38163
--webserver_port=33583
--webserver_interface=127.1.55.194
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:16.564407 15622 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:06:16.564695 15622 tablet_bootstrap.cc:492] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Bootstrap complete.
I20260620 22:06:16.565701 15622 ts_tablet_manager.cc:1397] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.006s
I20260620 22:06:16.566489 15622 raft_consensus.cc:348] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:16.566713 15622 raft_consensus.cc:729] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 303c508c792045148b0c5ba47100a302, State: Initialized, Role: FOLLOWER
I20260620 22:06:16.566854 15622 consensus_queue.cc:260] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.567117 15622 ts_tablet_manager.cc:1428] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260620 22:06:16.571028 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.559759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:34069 (local address 127.1.55.254:38163)
0620 22:06:16.560980 (+ 1221us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.560991 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.561023 (+ 32us) server_negotiation.cc:407] Connection header received
0620 22:06:16.561144 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.561151 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.561213 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.561367 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:16.561982 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.563226 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.564616 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.565061 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.565172 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.567670 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:16.567674 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:16.567674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:16.567701 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:16.569420 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.569871 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.569874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.569875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.569959 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.570215 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.570216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.570216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.570418 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:16.570504 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.570757 (+ 253us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.570873 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1168,"thread_start_us":95,"threads_started":1}
I20260620 22:06:16.571027 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.559675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:34069)
0620 22:06:16.559968 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.560031 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.560694 (+ 663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.561398 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.561401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.561704 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:16.561867 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.561871 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.563341 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.563342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.564511 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.564514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.565163 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.565165 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.565280 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.565792 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:16.565800 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:16.567558 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:16.569547 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.569553 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.569555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.569774 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.570030 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.570031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.570031 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.570148 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.570487 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:16.570493 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:16.570614 (+ 121us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.570709 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.570857 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":90,"threads_started":1}
I20260620 22:06:16.571797 15730 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38163
I20260620 22:06:16.571902 15730 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:16.572067 15730 heartbeater.cc:511] Master 127.1.55.254:38163 requested a full tablet report, sending...
I20260620 22:06:16.572748 15542 ts_manager.cc:194] Registered new tserver with Master: 303c508c792045148b0c5ba47100a302 (127.1.55.193:37845)
I20260620 22:06:16.573988 15542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:34069
I20260620 22:06:16.574812 15730 heartbeater.cc:503] Master 127.1.55.254:38163 was elected leader, sending a full tablet report...
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.193@KRBTEST.COM
I20260620 22:06:16.581612 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.573332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:37845 (local address 127.0.0.1:48824)
0620 22:06:16.573511 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.573541 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.573600 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.574526 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.574532 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.574827 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:16.574874 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.574876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.576222 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.576222 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.576706 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.576708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.577245 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.577246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.577294 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.577740 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:16.577744 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:16.578811 (+ 1067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:16.580634 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.580639 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.580640 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.580818 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.581022 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.581023 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.581023 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.581081 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.581345 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:16.581350 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:16.581383 (+ 33us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.581436 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.581557 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":93,"threads_started":1}
I20260620 22:06:16.581645 15738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.574266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48824 (local address 127.1.55.193:37845)
0620 22:06:16.574395 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.574398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.574405 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:06:16.574430 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.574431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.574440 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.574517 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:16.575013 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.576128 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.576778 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.577177 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.577248 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.578881 (+ 1633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:16.578888 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:16.578888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:16.578894 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:16.580555 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.580896 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.580899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.580899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.580957 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.581133 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.581134 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.581134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.581289 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:16.581359 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.581467 (+ 108us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.581563 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
I20260620 22:06:16.582068 15664 tablet_service.cc:1514] Processing DeleteTablet for tablet 19c9c4d2731140a0a6e09a704d259e59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:16 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:48824
I20260620 22:06:16.582469 15739 tablet_replica.cc:330] stopping tablet replica
I20260620 22:06:16.582564 15739 raft_consensus.cc:2229] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:16.582619 15739 raft_consensus.cc:2258] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:16.582836 15739 ts_tablet_manager.cc:1905] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:16.584440 15739 ts_tablet_manager.cc:1918] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:16.584494 15739 log.cc:1196] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/19c9c4d2731140a0a6e09a704d259e59
I20260620 22:06:16.584722 15739 ts_tablet_manager.cc:1939] T 19c9c4d2731140a0a6e09a704d259e59 P 303c508c792045148b0c5ba47100a302: Deleting consensus metadata
I20260620 22:06:16.585127 15528 catalog_manager.cc:4841] TS 303c508c792045148b0c5ba47100a302 (127.1.55.193:37845): tablet 19c9c4d2731140a0a6e09a704d259e59 (table test-table [id=99d8843ebafe43aeb7b174e76b12ff09]) successfully deleted
W20260620 22:06:16.643819 15735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:16.644027 15735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:16.644075 15735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:16.645109 15735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:16.645169 15735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:16.645208 15735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:06:16.646575 15735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:34107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=33583
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:16.646875 15735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:16.647099 15735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:16.651836 15745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.651844 15747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.651937 15735 server_base.cc:1034] running on GCE node
W20260620 22:06:16.651844 15744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.652211 15735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:16.652452 15735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:16.653597 15735 hybrid_clock.cc:648] HybridClock initialized: now 1781993176653582 us; error 29 us; skew 500 ppm
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:16.655815 15735 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:06:16.656263 15735 webserver.cc:460] Webserver started at http://127.1.55.194:33583/ using document root <none> and password file <none>
I20260620 22:06:16.656498 15735 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:16.656575 15735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:16.657851 15735 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:16.658342 15754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.658494 15735 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:16.658586 15735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "084ef22a58274d5db1bfb45d6e455b52"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "d920c84065c9fa4f3e76879d93178ad8"
server_key_iv: "db33d4e7ea31ab94404b3cdadcb1425e"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.658882 15735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:16.677390 15735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:16.678989 15735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:16.679141 15735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:16.679351 15735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:16.679627 15735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:16.679682 15735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.679719 15735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:16.679756 15735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.685288 15735 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:34107
I20260620 22:06:16.685331 15867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:34107 every 8 connection(s)
I20260620 22:06:16.685619 15735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:06:16.689585 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 15735
I20260620 22:06:16.689895 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:40755
--local_ip_for_outbound_sockets=127.1.55.195
--tserver_master_addrs=127.1.55.254:38163
--webserver_port=35261
--webserver_interface=127.1.55.195
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:16.694561 15870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.686194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:50455)
0620 22:06:16.686342 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.686375 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.686775 (+ 400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.686962 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.686964 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.687451 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:16.687612 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.687616 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.688299 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.688299 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.689032 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.689034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.689393 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.689394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.689560 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.690003 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:16.690013 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:16.691567 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:16.693297 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.693303 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.693305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.693573 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.693783 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.693783 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.693783 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.693879 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.694159 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:16.694162 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:16.694259 (+ 97us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.694331 (+ 72us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.694431 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":87,"threads_started":1}
I20260620 22:06:16.694591 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.686200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:50455 (local address 127.1.55.254:38163)
0620 22:06:16.686255 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.686257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.686434 (+ 177us) server_negotiation.cc:407] Connection header received
0620 22:06:16.686851 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.686852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.686862 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.686909 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:16.687688 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.688219 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.689105 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.689305 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.689356 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.691663 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:16.691664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:16.691664 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:16.691670 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:16.693218 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.693645 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.693646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.693647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.693709 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.693945 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.693946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.693947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.694096 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:16.694166 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.694380 (+ 214us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.694470 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:06:16.695046 15868 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38163
I20260620 22:06:16.695143 15868 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:16.695323 15868 heartbeater.cc:511] Master 127.1.55.254:38163 requested a full tablet report, sending...
I20260620 22:06:16.695663 15542 ts_manager.cc:194] Registered new tserver with Master: 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
I20260620 22:06:16.696017 15542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:50455
W20260620 22:06:16.766973 15871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:16.767175 15871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:16.767211 15871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:16.768333 15871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:16.768396 15871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:16.768440 15871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:06:16.769868 15871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:40755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=35261
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:16.770102 15871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:16.770334 15871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:16.774582 15876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.774618 15877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:16.774582 15879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:16.774736 15871 server_base.cc:1034] running on GCE node
I20260620 22:06:16.774955 15871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:16.775162 15871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:16.776304 15871 hybrid_clock.cc:648] HybridClock initialized: now 1781993176776290 us; error 39 us; skew 500 ppm
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:16.778460 15871 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:06:16.778841 15871 webserver.cc:460] Webserver started at http://127.1.55.195:35261/ using document root <none> and password file <none>
I20260620 22:06:16.779089 15871 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:16.779171 15871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:16.780382 15871 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:16.780907 15886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.781082 15871 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:16.781170 15871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "26af8fd170d84daca544bcadca80d259"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "2e98825b258ca5b2a6fbb575c22b0b38"
server_key_iv: "0068be8aedba0db1516df734d6f181a5"
server_key_version: "encryptionkey@0"
I20260620 22:06:16.781446 15871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:16.812278 15871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:16.813959 15871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:16.814129 15871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:16.814339 15871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:16.814611 15871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:16.814661 15871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.814692 15871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:16.814716 15871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:16.820286 15871 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:40755
I20260620 22:06:16.820322 15999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:40755 every 8 connection(s)
I20260620 22:06:16.820616 15871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:06:16.825160 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 15871
Jun 20 22:06:16 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993176, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:16.829984 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.821204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:38919 (local address 127.1.55.254:38163)
0620 22:06:16.821271 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.821272 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.821449 (+ 177us) server_negotiation.cc:407] Connection header received
0620 22:06:16.821973 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.821974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.821983 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.822032 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:16.822847 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.823314 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.824179 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.824372 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.824440 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.826593 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:16.826594 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:16.826595 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:16.826600 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:16.828247 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.828701 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.828702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.828702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.828776 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.829314 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.829315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.829316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.829457 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:16.829553 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.829791 (+ 238us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.829866 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260620 22:06:16.830029 16002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.821191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:38919)
0620 22:06:16.821333 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.821366 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.821890 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.822086 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.822089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.822599 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:16.822776 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.822779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.823387 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.823388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.824107 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.824108 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.824464 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.824465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.824552 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.824969 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:16.824976 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:16.826500 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:16.828326 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.828332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.828334 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.828633 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.829126 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:16.829127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:16.829127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:16.829239 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:16.829553 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:16.829557 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:16.829658 (+ 101us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.829739 (+ 81us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.829846 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260620 22:06:16.830675 16000 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38163
I20260620 22:06:16.830782 16000 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:16.831256 16000 heartbeater.cc:511] Master 127.1.55.254:38163 requested a full tablet report, sending...
I20260620 22:06:16.831604 15542 ts_manager.cc:194] Registered new tserver with Master: 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755)
I20260620 22:06:16.832020 15542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:38919
I20260620 22:06:16.832818 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.825568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45278 (local address 127.1.55.254:38163)
0620 22:06:16.825707 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.825709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.825749 (+ 40us) server_negotiation.cc:407] Connection header received
0620 22:06:16.825816 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.825817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.825827 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.825915 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:16.826472 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.827136 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.828226 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.828507 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.828593 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.829989 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:16.829990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:16.829990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:16.829997 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:16.831604 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.832031 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.832032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.832032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.832083 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:16.832337 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:16.832338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:16.832338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:16.832452 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:16.832616 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.832652 (+ 36us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.832734 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260620 22:06:16.833546 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:06:16.836064 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.833872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45284 (local address 127.1.55.254:38163)
0620 22:06:16.833926 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.833927 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.833978 (+ 51us) server_negotiation.cc:407] Connection header received
0620 22:06:16.834054 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.834055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.834084 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.834157 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:06:16.834266 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.834663 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.835322 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.835514 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.835590 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.835755 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:06:16.835841 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:06:16.835937 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.835977 (+ 40us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.835998 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:06:16.836331 15542 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45284:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:06:16.837839 15542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:06:16.839833 15664 tablet_service.cc:1467] Processing CreateTablet for tablet 874f963f0aa64ec49f06c8a4b1d2fba8 (DEFAULT_TABLE table=test-table [id=7e9eb30ca8d844c08437d6e21a7f7972]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:16.840015 15664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874f963f0aa64ec49f06c8a4b1d2fba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:16.841574 15622 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Bootstrap starting.
I20260620 22:06:16.841866 15622 tablet_bootstrap.cc:654] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:16.842693 15622 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: No bootstrap required, opened a new log
I20260620 22:06:16.842756 15622 ts_tablet_manager.cc:1397] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:16.842903 15622 raft_consensus.cc:348] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.842975 15622 raft_consensus.cc:374] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:16.843021 15622 raft_consensus.cc:729] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 303c508c792045148b0c5ba47100a302, State: Initialized, Role: FOLLOWER
I20260620 22:06:16.843062 15622 consensus_queue.cc:260] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.843152 15622 ts_tablet_manager.cc:1428] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:16.843282 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.839488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40755 (local address 127.0.0.1:58098)
0620 22:06:16.839583 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.839593 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.839632 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.839874 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.839875 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.839876 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.839926 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.839928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.841016 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.841017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.842082 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.842084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.843044 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.843045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.843112 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.843131 (+ 19us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.843162 (+ 31us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.843207 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260620 22:06:16.843601 16007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.839575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.1.55.195:40755)
0620 22:06:16.839704 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.839708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.839716 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:16.839754 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.839756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.839774 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.839867 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.840005 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.840923 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.842183 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.842950 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.843380 (+ 430us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.843458 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.843482 (+ 24us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.843514 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":72,"threads_started":1}
I20260620 22:06:16.843739 16008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.839592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48612 (local address 127.1.55.194:34107)
0620 22:06:16.839788 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.839792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.839901 (+ 109us) server_negotiation.cc:407] Connection header received
0620 22:06:16.840007 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.840010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.840026 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.840106 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.840287 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.841237 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.842529 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.843194 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.843275 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.843328 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.843620 (+ 292us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.843660 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":88,"threads_started":1}
I20260620 22:06:16.843827 16006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.839494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34107 (local address 127.0.0.1:48612)
0620 22:06:16.839841 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.839850 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.839926 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.840111 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.840112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.840114 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.840157 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.840158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.841353 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.841354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.842447 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.842450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.843285 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.843286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.843503 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.843507 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.843604 (+ 97us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.843752 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":10,"thread_start_us":74,"threads_started":1}
I20260620 22:06:16.844156 15934 tablet_service.cc:1467] Processing CreateTablet for tablet 874f963f0aa64ec49f06c8a4b1d2fba8 (DEFAULT_TABLE table=test-table [id=7e9eb30ca8d844c08437d6e21a7f7972]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:16.844426 15934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874f963f0aa64ec49f06c8a4b1d2fba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:16.844347 15802 tablet_service.cc:1467] Processing CreateTablet for tablet 874f963f0aa64ec49f06c8a4b1d2fba8 (DEFAULT_TABLE table=test-table [id=7e9eb30ca8d844c08437d6e21a7f7972]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:16.844617 15802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 874f963f0aa64ec49f06c8a4b1d2fba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:16.846756 16010 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: Bootstrap starting.
I20260620 22:06:16.847018 16011 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Bootstrap starting.
I20260620 22:06:16.847379 16010 tablet_bootstrap.cc:654] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:16.847613 16011 tablet_bootstrap.cc:654] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:16.847781 16010 log.cc:824] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:16.848151 16011 log.cc:824] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:16.848444 16010 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: No bootstrap required, opened a new log
I20260620 22:06:16.848513 16010 ts_tablet_manager.cc:1397] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:06:16.848820 16011 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: No bootstrap required, opened a new log
I20260620 22:06:16.848873 16011 ts_tablet_manager.cc:1397] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:06:16.849953 16010 raft_consensus.cc:348] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.850145 16010 raft_consensus.cc:374] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:16.850189 16010 raft_consensus.cc:729] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26af8fd170d84daca544bcadca80d259, State: Initialized, Role: FOLLOWER
I20260620 22:06:16.850301 16010 consensus_queue.cc:260] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.850570 16010 ts_tablet_manager.cc:1428] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:06:16.850605 16000 heartbeater.cc:503] Master 127.1.55.254:38163 was elected leader, sending a full tablet report...
I20260620 22:06:16.850489 16011 raft_consensus.cc:348] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.850666 16011 raft_consensus.cc:374] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:16.850708 16011 raft_consensus.cc:729] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 084ef22a58274d5db1bfb45d6e455b52, State: Initialized, Role: FOLLOWER
I20260620 22:06:16.850822 16011 consensus_queue.cc:260] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.851095 16011 ts_tablet_manager.cc:1428] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:16.851122 15868 heartbeater.cc:503] Master 127.1.55.254:38163 was elected leader, sending a full tablet report...
I20260620 22:06:16.907516 15736 raft_consensus.cc:482] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:16.907655 15736 raft_consensus.cc:504] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.908043 15736 leader_election.cc:288] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755), 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
I20260620 22:06:16.910805 16008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.908298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:38253 (local address 127.1.55.194:34107)
0620 22:06:16.908346 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.908348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.908358 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:06:16.908388 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.908389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.908397 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.908456 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.908611 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.909156 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.910098 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.910462 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.910545 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.910553 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.910710 (+ 157us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.910745 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:06:16.910805 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.908200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34107 (local address 127.1.55.193:38253)
0620 22:06:16.908264 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.908278 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.908332 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.908472 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.908472 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.908474 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.908547 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.908550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.909238 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.909239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.909995 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.909997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.910540 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.910541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.910613 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.910628 (+ 15us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.910690 (+ 62us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.910731 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260620 22:06:16.911041 16016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.908242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40755 (local address 127.1.55.193:36453)
0620 22:06:16.908449 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.908458 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:16.908503 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:16.908698 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:16.908698 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:16.908700 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:16.908764 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.908765 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.909360 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.909361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.910187 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:16.910189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.910745 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.910746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:16.910819 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.910822 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:06:16.910887 (+ 65us) client_negotiation.cc:240] Negotiation successful
0620 22:06:16.910932 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":94,"threads_started":1}
I20260620 22:06:16.911103 16007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.908407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:36453 (local address 127.1.55.195:40755)
0620 22:06:16.908457 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.908459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.908495 (+ 36us) server_negotiation.cc:407] Connection header received
0620 22:06:16.908587 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.908588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.908597 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.908691 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:16.908824 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.909270 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.910288 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.910629 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.910718 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.910726 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.911004 (+ 278us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.911040 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:06:16.911118 15822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874f963f0aa64ec49f06c8a4b1d2fba8" candidate_uuid: "303c508c792045148b0c5ba47100a302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "084ef22a58274d5db1bfb45d6e455b52" is_pre_election: true
I20260620 22:06:16.911283 15822 raft_consensus.cc:2454] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 303c508c792045148b0c5ba47100a302 in term 0.
I20260620 22:06:16.911353 15954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874f963f0aa64ec49f06c8a4b1d2fba8" candidate_uuid: "303c508c792045148b0c5ba47100a302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26af8fd170d84daca544bcadca80d259" is_pre_election: true
I20260620 22:06:16.911490 15954 raft_consensus.cc:2454] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 303c508c792045148b0c5ba47100a302 in term 0.
I20260620 22:06:16.911545 15619 leader_election.cc:302] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 084ef22a58274d5db1bfb45d6e455b52, 303c508c792045148b0c5ba47100a302; no voters:
I20260620 22:06:16.911660 15736 raft_consensus.cc:2781] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:06:16.911726 15736 raft_consensus.cc:482] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:06:16.911769 15736 raft_consensus.cc:3037] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:16.912449 15736 raft_consensus.cc:504] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.912603 15736 leader_election.cc:288] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 1 election: Requested vote from peers 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755), 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
I20260620 22:06:16.912756 15822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874f963f0aa64ec49f06c8a4b1d2fba8" candidate_uuid: "303c508c792045148b0c5ba47100a302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "084ef22a58274d5db1bfb45d6e455b52"
I20260620 22:06:16.912815 15954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "874f963f0aa64ec49f06c8a4b1d2fba8" candidate_uuid: "303c508c792045148b0c5ba47100a302" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26af8fd170d84daca544bcadca80d259"
I20260620 22:06:16.912842 15822 raft_consensus.cc:3037] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:16.912871 15954 raft_consensus.cc:3037] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:16.913733 15822 raft_consensus.cc:2454] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 303c508c792045148b0c5ba47100a302 in term 1.
I20260620 22:06:16.913733 15954 raft_consensus.cc:2454] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 303c508c792045148b0c5ba47100a302 in term 1.
I20260620 22:06:16.913884 15619 leader_election.cc:302] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 084ef22a58274d5db1bfb45d6e455b52, 303c508c792045148b0c5ba47100a302; no voters:
I20260620 22:06:16.913971 15736 raft_consensus.cc:2781] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:16.914121 15736 raft_consensus.cc:686] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 LEADER]: Becoming Leader. State: Replica: 303c508c792045148b0c5ba47100a302, State: Running, Role: LEADER
I20260620 22:06:16.914211 15736 consensus_queue.cc:237] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:16.914870 15541 catalog_manager.cc:5495] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 reported cstate change: term changed from 0 to 1, leader changed from <none> to 303c508c792045148b0c5ba47100a302 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "303c508c792045148b0c5ba47100a302" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } health_report { overall_health: HEALTHY } } }
W20260620 22:06:16.936074 15869 tablet.cc:2369] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:06:16.937520 15738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.935502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48836 (local address 127.1.55.193:37845)
0620 22:06:16.935552 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:16.935553 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:16.935560 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:06:16.935628 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:16.935629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:16.935641 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:16.935692 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:06:16.935802 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.936238 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.936885 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:16.937094 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:16.937136 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:16.937253 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:06:16.937333 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:06:16.937379 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:16.937416 (+ 37us) server_negotiation.cc:299] Negotiation successful
0620 22:06:16.937430 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:06:16.938740 15822 raft_consensus.cc:1261] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 1 FOLLOWER]: Refusing update from remote peer 303c508c792045148b0c5ba47100a302: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:16.938745 15954 raft_consensus.cc:1261] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 1 FOLLOWER]: Refusing update from remote peer 303c508c792045148b0c5ba47100a302: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:16.939050 16017 consensus_queue.cc:1035] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:16.939188 15736 consensus_queue.cc:1035] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:16.941210 16020 mvcc.cc:205] Tried to move back new op lower bound from 7299044052738859008 to 7299044052641181696. Current Snapshot: MvccSnapshot[applied={T|T < 7299044052738859008}]
I20260620 22:06:16.941357 16022 mvcc.cc:205] Tried to move back new op lower bound from 7299044052738859008 to 7299044052641181696. Current Snapshot: MvccSnapshot[applied={T|T < 7299044052738859008}]
I20260620 22:06:16.941898 16021 mvcc.cc:205] Tried to move back new op lower bound from 7299044052738859008 to 7299044052641181696. Current Snapshot: MvccSnapshot[applied={T|T < 7299044052738859008}]
I20260620 22:06:16.943682 15542 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:16.943779 15542 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:16.944387 15542 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Sending DeleteTablet for 3 replicas of tablet 874f963f0aa64ec49f06c8a4b1d2fba8
I20260620 22:06:16.944676 15802 tablet_service.cc:1514] Processing DeleteTablet for tablet 874f963f0aa64ec49f06c8a4b1d2fba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:16 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:48612
I20260620 22:06:16.944718 15664 tablet_service.cc:1514] Processing DeleteTablet for tablet 874f963f0aa64ec49f06c8a4b1d2fba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:16 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:48824
I20260620 22:06:16.944737 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 15580
I20260620 22:06:16.944839 15739 tablet_replica.cc:330] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: stopping tablet replica
I20260620 22:06:16.944886 15739 raft_consensus.cc:2229] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:06:16.944962 15739 raft_consensus.cc:2258] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:16.945060 16029 tablet_replica.cc:330] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: stopping tablet replica
I20260620 22:06:16.945129 16029 raft_consensus.cc:2229] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:16.945214 16029 raft_consensus.cc:2258] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:16.945575 16029 ts_tablet_manager.cc:1905] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:16.946167 15934 tablet_service.cc:1514] Processing DeleteTablet for tablet 874f963f0aa64ec49f06c8a4b1d2fba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:16 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:58098
I20260620 22:06:16.946336 16030 tablet_replica.cc:330] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: stopping tablet replica
I20260620 22:06:16.946457 16030 raft_consensus.cc:2229] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:16.946544 16030 raft_consensus.cc:2258] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:16.946884 16030 ts_tablet_manager.cc:1905] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:16.947288 16029 ts_tablet_manager.cc:1918] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:16.947359 16029 log.cc:1196] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/874f963f0aa64ec49f06c8a4b1d2fba8
I20260620 22:06:16.947626 16029 ts_tablet_manager.cc:1939] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 084ef22a58274d5db1bfb45d6e455b52: Deleting consensus metadata
I20260620 22:06:16.948021 15529 catalog_manager.cc:4841] TS 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107): tablet 874f963f0aa64ec49f06c8a4b1d2fba8 (table test-table [id=7e9eb30ca8d844c08437d6e21a7f7972]) successfully deleted
I20260620 22:06:16.948351 16030 ts_tablet_manager.cc:1918] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:16.948437 16030 log.cc:1196] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/874f963f0aa64ec49f06c8a4b1d2fba8
I20260620 22:06:16.948712 16030 ts_tablet_manager.cc:1939] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 26af8fd170d84daca544bcadca80d259: Deleting consensus metadata
I20260620 22:06:16.949128 15527 catalog_manager.cc:4841] TS 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755): tablet 874f963f0aa64ec49f06c8a4b1d2fba8 (table test-table [id=7e9eb30ca8d844c08437d6e21a7f7972]) successfully deleted
W20260620 22:06:16.950903 15528 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:37845 (error 108)
I20260620 22:06:16.951310 16006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:16.951196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:37845 (local address 127.0.0.1:48852)
0620 22:06:16.951250 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:16.951287 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:37845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260620 22:06:16.951431 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 15735
W20260620 22:06:16.951416 15528 catalog_manager.cc:4584] TS 303c508c792045148b0c5ba47100a302 (127.1.55.193:37845): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 874f963f0aa64ec49f06c8a4b1d2fba8: Network error: Client connection negotiation failed: client connection to 127.1.55.193:37845: connect: Connection refused (error 111)
I20260620 22:06:16.955927 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 15871
I20260620 22:06:16.959822 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 15509
I20260620 22:06:16.964373 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38163
--webserver_interface=127.1.55.254
--webserver_port=40957
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38163
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:17.039330 16032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:17.039551 16032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:17.039588 16032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:17.040772 16032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:17.040834 16032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:17.040860 16032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:17.040890 16032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:17.040912 16032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:17.042358 16032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=40957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:17.042611 16032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:17.042821 16032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:17.047097 16037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:17.047097 16038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:17.047179 16040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:17.047312 16032 server_base.cc:1034] running on GCE node
I20260620 22:06:17.047544 16032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:17.047839 16032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:17.048977 16032 hybrid_clock.cc:648] HybridClock initialized: now 1781993177048955 us; error 37 us; skew 500 ppm
Jun 20 22:06:17 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993177, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:17.051259 16032 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:17.051684 16032 webserver.cc:460] Webserver started at http://127.1.55.254:40957/ using document root <none> and password file <none>
I20260620 22:06:17.051877 16032 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:17.051918 16032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:17.053057 16032 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:17.053687 16047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.053843 16032 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:06:17.053931 16032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "a55662a778ac4f0a81441ea804f34f9f"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "8260bc005be8929938f9a04f6f0a040d"
server_key_iv: "6e43c783e6d0e8476fd796e2d473c011"
server_key_version: "encryptionkey@0"
I20260620 22:06:17.054203 16032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:17.072831 16032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:17.074436 16032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:17.074594 16032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:17.078459 16032 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:38163
I20260620 22:06:17.078492 16099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:38163 every 8 connection(s)
I20260620 22:06:17.078802 16032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:17.080093 16100 sys_catalog.cc:263] Verifying existing consensus state
I20260620 22:06:17.080704 16100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Bootstrap starting.
I20260620 22:06:17.088438 16100 log.cc:824] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:17.088732 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 16032
I20260620 22:06:17.089035 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:37845
--local_ip_for_outbound_sockets=127.1.55.193
--tserver_master_addrs=127.1.55.254:38163
--webserver_port=38655
--webserver_interface=127.1.55.193
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:17.090590 16100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:06:17.090840 16100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f: Bootstrap complete.
I20260620 22:06:17.092808 16100 raft_consensus.cc:348] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:17.093016 16100 raft_consensus.cc:729] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a55662a778ac4f0a81441ea804f34f9f, State: Initialized, Role: FOLLOWER
I20260620 22:06:17.093176 16100 consensus_queue.cc:260] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:17.093240 16100 raft_consensus.cc:388] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:06:17.093283 16100 raft_consensus.cc:482] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:06:17.093323 16100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 2 FOLLOWER]: Advancing to term 3
I20260620 22:06:17.094174 16100 raft_consensus.cc:504] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:17.094276 16100 leader_election.cc:302] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a55662a778ac4f0a81441ea804f34f9f; no voters:
I20260620 22:06:17.094424 16100 leader_election.cc:288] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260620 22:06:17.094451 16104 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 3 FOLLOWER]: Leader election won for term 3
I20260620 22:06:17.094538 16104 raft_consensus.cc:686] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [term 3 LEADER]: Becoming Leader. State: Replica: a55662a778ac4f0a81441ea804f34f9f, State: Running, Role: LEADER
I20260620 22:06:17.094614 16104 consensus_queue.cc:237] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } }
I20260620 22:06:17.094641 16100 sys_catalog.cc:564] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:17.095031 16104 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a55662a778ac4f0a81441ea804f34f9f. Latest consensus state: current_term: 3 leader_uuid: "a55662a778ac4f0a81441ea804f34f9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } } }
I20260620 22:06:17.095031 16105 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "a55662a778ac4f0a81441ea804f34f9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55662a778ac4f0a81441ea804f34f9f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38163 } } }
I20260620 22:06:17.095129 16104 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:17.095160 16105 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55662a778ac4f0a81441ea804f34f9f [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:17.095356 16108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:17.096127 16108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:06:17.096232 16108 catalog_manager.cc:1259] Loaded cluster ID: 5f602e19a4a5440980988dbc1bc5d18c
I20260620 22:06:17.096273 16108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260620 22:06:17.096526 16108 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f790f57e9ad google::LogMessage::Fail() at ??:0
@ 0x7f790f58188a google::LogMessage::SendToLog() at ??:0
@ 0x7f790f57e4de google::LogMessage::Flush() at ??:0
@ 0x7f790f57fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f79174a30f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f79174ac8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f791144c0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f7911441954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f79122a56db start_thread at ??:0
@ 0x7f790e07c61f clone at ??:0
W20260620 22:06:17.174429 16103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:17.174621 16103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:17.174655 16103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:17.175747 16103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:17.175804 16103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:17.175848 16103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:06:17.177222 16103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:37845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=38655
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:17.177506 16103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:17.177721 16103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:17.182354 16136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:17.182394 16103 server_base.cc:1034] running on GCE node
W20260620 22:06:17.182466 16137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:17.182363 16139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:17.182726 16103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:17.182972 16103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:17.184114 16103 hybrid_clock.cc:648] HybridClock initialized: now 1781993177184087 us; error 49 us; skew 500 ppm
Jun 20 22:06:17 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993177, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:17.186477 16103 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:06:17.186861 16103 webserver.cc:460] Webserver started at http://127.1.55.193:38655/ using document root <none> and password file <none>
I20260620 22:06:17.187067 16103 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:17.187126 16103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:17.188484 16103 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:17.189185 16146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.189364 16103 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:17.189446 16103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "303c508c792045148b0c5ba47100a302"
format_stamp: "Formatted at 2026-06-20 22:06:15 on dist-test-slave-xw35"
server_key: "a67320442a32fa1682bdf80ecbb0f7e1"
server_key_iv: "f420ba788e530758eec9e8e69e8e8056"
server_key_version: "encryptionkey@0"
I20260620 22:06:17.189788 16103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:17.209399 16103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:17.211573 16103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:17.211719 16103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:17.211937 16103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:17.212383 16153 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 22:06:17.214087 16103 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 22:06:17.214136 16103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260620 22:06:17.214174 16103 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 22:06:17.214720 16103 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 22:06:17.214767 16103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:17.214825 16153 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Bootstrap starting.
I20260620 22:06:17.221410 16103 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:37845
I20260620 22:06:17.221553 16260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:37845 every 8 connection(s)
I20260620 22:06:17.221799 16103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:06:17.223666 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 16103
I20260620 22:06:17.223944 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:34107
--local_ip_for_outbound_sockets=127.1.55.194
--tserver_master_addrs=127.1.55.254:38163
--webserver_port=33583
--webserver_interface=127.1.55.194
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:17.225118 16153 log.cc:824] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:17.227562 16153 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:06:17.227916 16153 tablet_bootstrap.cc:492] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Bootstrap complete.
I20260620 22:06:17.229147 16153 ts_tablet_manager.cc:1397] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20260620 22:06:17.230671 16153 raft_consensus.cc:348] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:17.231035 16153 raft_consensus.cc:729] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 303c508c792045148b0c5ba47100a302, State: Initialized, Role: FOLLOWER
I20260620 22:06:17.231189 16153 consensus_queue.cc:260] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:17.231451 16153 ts_tablet_manager.cc:1428] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
W20260620 22:06:17.268213 16263 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:06:17.222407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:49633)
0620 22:06:17.222559 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.222598 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:17.223029 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:17.268035 (+ 45006us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
W20260620 22:06:17.268462 16261 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:38163 (0 consecutive failures): Network error: Failed to ping master at 127.1.55.254:38163: Client connection negotiation failed: client connection to 127.1.55.254:38163: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 22:06:17.268808 16263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:17.268689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:40065)
0620 22:06:17.268745 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.268786 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260620 22:06:17.269130 16263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:17.269046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:50121)
0620 22:06:17.269089 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.269114 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260620 22:06:17.269309 16261 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 22:06:17.302685 16264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:17.302879 16264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:17.302918 16264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:17.304036 16264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:17.304097 16264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:17.304140 16264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:06:17.305454 16264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:34107
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=33583
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:17.305718 16264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:17.305910 16264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:17.310281 16272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:17.310286 16271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:17.310293 16274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:17.310503 16264 server_base.cc:1034] running on GCE node
I20260620 22:06:17.310734 16264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:17.310938 16264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:17.312085 16264 hybrid_clock.cc:648] HybridClock initialized: now 1781993177312077 us; error 24 us; skew 500 ppm
Jun 20 22:06:17 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993177, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:17.314466 16264 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:06:17.314917 16264 webserver.cc:460] Webserver started at http://127.1.55.194:33583/ using document root <none> and password file <none>
I20260620 22:06:17.315065 16264 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:17.315099 16264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:17.316190 16264 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:17.316664 16281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.316841 16264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.316927 16264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "084ef22a58274d5db1bfb45d6e455b52"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "d920c84065c9fa4f3e76879d93178ad8"
server_key_iv: "db33d4e7ea31ab94404b3cdadcb1425e"
server_key_version: "encryptionkey@0"
I20260620 22:06:17.317205 16264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:17.345362 16264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:17.347358 16264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:17.347494 16264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:17.347695 16264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:17.347998 16264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:17.348050 16264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.348086 16264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:17.348114 16264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.353576 16264 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:34107
I20260620 22:06:17.353771 16394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:34107 every 8 connection(s)
I20260620 22:06:17.353952 16264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:06:17.354892 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:17.354556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:38593)
0620 22:06:17.354688 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.354770 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":57,"threads_started":1}
W20260620 22:06:17.355276 16395 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:38163 (0 consecutive failures): Network error: Failed to ping master at 127.1.55.254:38163: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
I20260620 22:06:17.355515 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:17.355438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:40435)
0620 22:06:17.355478 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.355501 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260620 22:06:17.355754 16397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:17.355680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:57047)
0620 22:06:17.355720 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.355742 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260620 22:06:17.355849 16395 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 22:06:17.360543 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 16264
I20260620 22:06:17.360816 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:40755
--local_ip_for_outbound_sockets=127.1.55.195
--tserver_master_addrs=127.1.55.254:38163
--webserver_port=35261
--webserver_interface=127.1.55.195
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:42375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:17.433732 16398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:17.433881 16398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:17.433902 16398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:17.434899 16398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:17.434932 16398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:17.434955 16398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:06:17.436296 16398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:42375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:40755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=35261
--tserver_master_addrs=127.1.55.254:38163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:17.436497 16398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:17.436686 16398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:06:17.441298 16398 server_base.cc:1034] running on GCE node
W20260620 22:06:17.441260 16406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:17.441268 16403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:17.441277 16404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:17.441740 16398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:17.441964 16398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:17.443082 16398 hybrid_clock.cc:648] HybridClock initialized: now 1781993177443074 us; error 26 us; skew 500 ppm
Jun 20 22:06:17 dist-test-slave-xw35 krb5kdc[14964](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993177, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:17.445259 16398 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:06:17.445668 16398 webserver.cc:460] Webserver started at http://127.1.55.195:35261/ using document root <none> and password file <none>
I20260620 22:06:17.445873 16398 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:17.445932 16398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:17.447077 16398 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:17.447610 16413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.447805 16398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:17.447887 16398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "26af8fd170d84daca544bcadca80d259"
format_stamp: "Formatted at 2026-06-20 22:06:16 on dist-test-slave-xw35"
server_key: "2e98825b258ca5b2a6fbb575c22b0b38"
server_key_iv: "0068be8aedba0db1516df734d6f181a5"
server_key_version: "encryptionkey@0"
I20260620 22:06:17.448173 16398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:17.467510 16398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:17.469731 16398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:17.469877 16398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:17.470085 16398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:17.470371 16398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:17.470419 16398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.470450 16398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:17.470475 16398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:17.475556 16398 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:40755
I20260620 22:06:17.475641 16526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:40755 every 8 connection(s)
I20260620 22:06:17.475917 16398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:06:17.476836 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:17.476517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:53583)
0620 22:06:17.476650 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.476709 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
W20260620 22:06:17.477198 16527 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:38163 (0 consecutive failures): Network error: Failed to ping master at 127.1.55.254:38163: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
I20260620 22:06:17.477440 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:17.477363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:43467)
0620 22:06:17.477401 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.477425 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260620 22:06:17.477774 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:17.477670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:45967)
0620 22:06:17.477728 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:17.477761 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260620 22:06:17.477921 16527 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 22:06:17.484938 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 16398
I20260620 22:06:18.269829 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:18.269625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:42479)
0620 22:06:18.269753 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:18.269780 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
I20260620 22:06:18.356384 16532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:18.356204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:56359)
0620 22:06:18.356312 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:18.356341 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260620 22:06:18.416301 16533 raft_consensus.cc:482] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:18.416411 16533 raft_consensus.cc:504] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:18.416749 16533 leader_election.cc:288] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755), 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
Jun 20 22:06:18 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993177, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.195@KRBTEST.COM
Jun 20 22:06:18 dist-test-slave-xw35 krb5kdc[14964](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993177, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.194@KRBTEST.COM
I20260620 22:06:18.427407 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:18.416880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:34107 (local address 127.1.55.193:38457)
0620 22:06:18.416930 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:18.416940 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:18.416991 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:18.417827 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:18.417829 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:18.418170 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:18.418338 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:18.418344 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:18.419402 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:18.419403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:18.420169 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:18.420171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:18.420848 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:18.420849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:18.420955 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:18.421734 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:18.421739 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:18.424236 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:18.425898 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:18.425899 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:18.425899 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:18.426150 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:18.426397 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:18.426397 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:18.426398 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:18.426522 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:18.426883 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:18.426889 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:18.427014 (+ 125us) client_negotiation.cc:769] Sending connection context
0620 22:06:18.427112 (+ 98us) client_negotiation.cc:240] Negotiation successful
0620 22:06:18.427308 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":58}
I20260620 22:06:18.427419 16536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:18.416987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:38457 (local address 127.1.55.194:34107)
0620 22:06:18.417134 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:18.417142 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:18.417168 (+ 26us) server_negotiation.cc:407] Connection header received
0620 22:06:18.417619 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:18.417622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:18.417657 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:18.417815 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:18.418455 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:18.419285 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:18.420308 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:18.420753 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:18.420877 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:18.424328 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:18.424331 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:18.424331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:18.424339 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:18.425808 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:18.426238 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:18.426240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:18.426241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:18.426323 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:18.426587 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:18.426588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:18.426588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:18.426810 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:18.426899 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:18.427173 (+ 274us) server_negotiation.cc:299] Negotiation successful
0620 22:06:18.427309 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":52,"threads_started":1}
I20260620 22:06:18.427428 16535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:18.416976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:40979 (local address 127.1.55.195:40755)
0620 22:06:18.417126 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:18.417135 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:18.417154 (+ 19us) server_negotiation.cc:407] Connection header received
0620 22:06:18.417591 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:18.417593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:18.417645 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:18.417828 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:18.418445 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:18.419356 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:18.420330 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:18.420808 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:18.420915 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:18.423713 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:18.423716 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:18.423717 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:18.423726 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:18.425787 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:18.426238 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:18.426241 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:18.426241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:18.426323 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:18.426586 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:18.426587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:18.426588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:18.426816 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:18.426899 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:18.427173 (+ 274us) server_negotiation.cc:299] Negotiation successful
0620 22:06:18.427328 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":58,"threads_started":1}
I20260620 22:06:18.427520 16534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:18.416880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40755 (local address 127.1.55.193:40979)
0620 22:06:18.416998 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:18.417005 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:18.417040 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:18.417832 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:18.417833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:18.418171 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:18.418339 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:18.418344 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:18.419444 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:18.419446 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:18.420170 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:18.420172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:18.420897 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:18.420898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:18.420957 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:18.421704 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:18.421714 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:18.423611 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:18.425881 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:18.425888 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:18.425890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:18.426150 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:18.426388 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:18.426389 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:18.426389 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:18.426514 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:18.426894 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:18.426894 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:18.427015 (+ 121us) client_negotiation.cc:769] Sending connection context
0620 22:06:18.427114 (+ 99us) client_negotiation.cc:240] Negotiation successful
0620 22:06:18.427386 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":145,"thread_start_us":44,"threads_started":1}
W20260620 22:06:18.428290 16148 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
W20260620 22:06:18.428941 16150 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
I20260620 22:06:18.428987 16150 leader_election.cc:302] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 303c508c792045148b0c5ba47100a302; no voters: 084ef22a58274d5db1bfb45d6e455b52, 26af8fd170d84daca544bcadca80d259
I20260620 22:06:18.429129 16533 raft_consensus.cc:2726] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:06:18.478430 16537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:18.478256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:50665)
0620 22:06:18.478368 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:18.478402 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260620 22:06:19.270440 16538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:19.270241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:38423)
0620 22:06:19.270359 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:19.270403 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260620 22:06:19.356933 16539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:19.356762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:53511)
0620 22:06:19.356873 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:19.356902 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
I20260620 22:06:19.479032 16540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:19.478832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:46311)
0620 22:06:19.478959 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:19.478996 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":55,"threads_started":1}
I20260620 22:06:19.965222 16541 raft_consensus.cc:482] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:19.965312 16541 raft_consensus.cc:504] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:19.965559 16541 leader_election.cc:288] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755), 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
W20260620 22:06:19.966022 16150 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
W20260620 22:06:19.966095 16148 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
I20260620 22:06:19.966133 16148 leader_election.cc:302] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 303c508c792045148b0c5ba47100a302; no voters: 084ef22a58274d5db1bfb45d6e455b52, 26af8fd170d84daca544bcadca80d259
I20260620 22:06:19.966223 16541 raft_consensus.cc:2726] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:06:20.271162 16542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:20.270892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:48739)
0620 22:06:20.271083 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:20.271117 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":55,"threads_started":1}
I20260620 22:06:20.357550 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:20.357300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:38989)
0620 22:06:20.357428 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:20.357459 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":54,"threads_started":1}
I20260620 22:06:20.479635 16544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:20.479457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:35105)
0620 22:06:20.479568 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:20.479601 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":54,"threads_started":1}
I20260620 22:06:21.271819 16545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:21.271608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:60603)
0620 22:06:21.271750 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:21.271778 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":82,"threads_started":1}
I20260620 22:06:21.358134 16546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:21.357945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:39193)
0620 22:06:21.358067 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:21.358101 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260620 22:06:21.480268 16547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:21.480081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:40147)
0620 22:06:21.480204 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:21.480233 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
I20260620 22:06:22.272574 16548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:22.272368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:58967)
0620 22:06:22.272493 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:22.272535 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260620 22:06:22.358770 16549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:22.358562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:56693)
0620 22:06:22.358693 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:22.358729 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
I20260620 22:06:22.480986 16550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:22.480807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:55591)
0620 22:06:22.480925 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:22.480955 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260620 22:06:22.529683 16551 raft_consensus.cc:482] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:22.529784 16551 raft_consensus.cc:504] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:22.529966 16551 leader_election.cc:288] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755), 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
W20260620 22:06:22.530364 16150 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
W20260620 22:06:22.530416 16148 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
I20260620 22:06:22.530443 16150 leader_election.cc:302] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 303c508c792045148b0c5ba47100a302; no voters: 084ef22a58274d5db1bfb45d6e455b52, 26af8fd170d84daca544bcadca80d259
I20260620 22:06:22.530503 16551 raft_consensus.cc:2726] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:06:23.273188 16552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:23.272961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:37419)
0620 22:06:23.273107 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:23.273143 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":71,"threads_started":1}
I20260620 22:06:23.359385 16553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:23.359161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:47883)
0620 22:06:23.359317 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:23.359351 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
I20260620 22:06:23.481668 16554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:23.481369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:38827)
0620 22:06:23.481600 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:23.481633 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":51,"threads_started":1}
I20260620 22:06:24.273947 16555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:24.273682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:50149)
0620 22:06:24.273877 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:24.273906 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":50,"threads_started":1}
I20260620 22:06:24.359982 16556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:24.359799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:39633)
0620 22:06:24.359916 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:24.359947 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":52,"threads_started":1}
I20260620 22:06:24.482288 16557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:24.482097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:39719)
0620 22:06:24.482222 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:24.482253 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":58,"threads_started":1}
I20260620 22:06:25.274487 16558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:25.274312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:56843)
0620 22:06:25.274417 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:25.274445 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":56,"threads_started":1}
I20260620 22:06:25.360579 16559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:25.360387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:38855)
0620 22:06:25.360507 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:25.360540 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":53,"threads_started":1}
I20260620 22:06:25.482860 16560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:25.482652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:51953)
0620 22:06:25.482797 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:25.482827 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":60,"threads_started":1}
I20260620 22:06:26.275002 16561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:26.274823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:54005)
0620 22:06:26.274934 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:26.274962 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":56,"threads_started":1}
I20260620 22:06:26.361303 16562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:26.361099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:49319)
0620 22:06:26.361202 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:26.361257 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":67,"threads_started":1}
I20260620 22:06:26.483395 16563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:26.483234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:52359)
0620 22:06:26.483336 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:26.483365 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":51,"threads_started":1}
I20260620 22:06:26.650730 16564 raft_consensus.cc:482] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:26.650827 16564 raft_consensus.cc:504] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:26.650951 16564 leader_election.cc:288] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755), 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
W20260620 22:06:26.651295 16150 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
W20260620 22:06:26.651382 16148 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
I20260620 22:06:26.651453 16148 leader_election.cc:302] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 303c508c792045148b0c5ba47100a302; no voters: 084ef22a58274d5db1bfb45d6e455b52, 26af8fd170d84daca544bcadca80d259
I20260620 22:06:26.651515 16564 raft_consensus.cc:2726] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:06:27.275674 16565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:27.275479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:46689)
0620 22:06:27.275601 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:27.275632 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":53,"threads_started":1}
I20260620 22:06:27.361896 16566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:27.361715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:37839)
0620 22:06:27.361829 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:27.361861 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260620 22:06:27.483925 16567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:27.483745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:47485)
0620 22:06:27.483859 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:27.483888 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260620 22:06:28.276422 16568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:28.276216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:38351)
0620 22:06:28.276342 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:28.276377 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":56,"threads_started":1}
I20260620 22:06:28.362479 16569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:28.362311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:45219)
0620 22:06:28.362413 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:28.362443 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":54,"threads_started":1}
I20260620 22:06:28.484766 16570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:28.484443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:41109)
0620 22:06:28.484691 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:28.484725 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":71,"threads_started":1}
I20260620 22:06:29.277050 16571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:29.276861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:52013)
0620 22:06:29.276974 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:29.277005 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":61,"threads_started":1}
I20260620 22:06:29.363050 16572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:29.362861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:56953)
0620 22:06:29.362978 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:29.363011 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":54,"threads_started":1}
I20260620 22:06:29.485419 16573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:29.485173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:49099)
0620 22:06:29.485349 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:29.485379 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
I20260620 22:06:30.277630 16574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:30.277421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:34661)
0620 22:06:30.277556 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:30.277587 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"threads_started":1}
I20260620 22:06:30.363646 16575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:30.363439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:37477)
0620 22:06:30.363577 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:30.363610 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260620 22:06:30.486027 16576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:30.485845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:33669)
0620 22:06:30.485961 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:30.485991 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":54,"threads_started":1}
I20260620 22:06:30.762305 16577 raft_consensus.cc:482] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:30.762408 16577 raft_consensus.cc:504] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26af8fd170d84daca544bcadca80d259" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40755 } } peers { permanent_uuid: "084ef22a58274d5db1bfb45d6e455b52" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 34107 } } peers { permanent_uuid: "303c508c792045148b0c5ba47100a302" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 37845 } }
I20260620 22:06:30.762612 16577 leader_election.cc:288] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755), 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107)
W20260620 22:06:30.762975 16148 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 26af8fd170d84daca544bcadca80d259 (127.1.55.195:40755): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
W20260620 22:06:30.763063 16150 leader_election.cc:341] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 084ef22a58274d5db1bfb45d6e455b52 (127.1.55.194:34107): Not found: Tablet not found: 874f963f0aa64ec49f06c8a4b1d2fba8
I20260620 22:06:30.763123 16150 leader_election.cc:302] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 303c508c792045148b0c5ba47100a302; no voters: 084ef22a58274d5db1bfb45d6e455b52, 26af8fd170d84daca544bcadca80d259
I20260620 22:06:30.763204 16577 raft_consensus.cc:2726] T 874f963f0aa64ec49f06c8a4b1d2fba8 P 303c508c792045148b0c5ba47100a302 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:06:31.278210 16578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:31.278020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:37947)
0620 22:06:31.278132 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:31.278165 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":53,"threads_started":1}
I20260620 22:06:31.364238 16579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:31.364042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:33443)
0620 22:06:31.364156 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:31.364188 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
I20260620 22:06:31.486662 16580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:31.486449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:35549)
0620 22:06:31.486591 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:31.486624 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260620 22:06:32.278892 16581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:32.278682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.193:43937)
0620 22:06:32.278815 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:32.278850 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260620 22:06:32.364867 16582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:32.364687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.194:43037)
0620 22:06:32.364807 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:32.364835 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
I20260620 22:06:32.487316 16583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:32.487133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38163 (local address 127.1.55.195:51899)
0620 22:06:32.487251 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:32.487282 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:38163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
I20260620 22:06:32.488612 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 16103
I20260620 22:06:32.493119 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 16264
I20260620 22:06:32.496873 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 16398
2026-06-20T22:06:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (17975 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:06:32 dist-test-slave-xw35 krb5kdc[16586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:06:32 dist-test-slave-xw35 krb5kdc[16586](info): set up 2 sockets
Jun 20 22:06:32 dist-test-slave-xw35 krb5kdc[16586](info): commencing operation
krb5kdc: starting...
W20260620 22:06:33.497419 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.981s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:06:33 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:06:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:06:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:06:33.606438 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40581
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:40581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:33.682744 16599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:33.682909 16599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:33.682928 16599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:33.683982 16599 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260620 22:06:33.684010 16599 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260620 22:06:33.684021 16599 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260620 22:06:33.684032 16599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:33.684043 16599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:33.684055 16599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:33.684067 16599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:33.684077 16599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:33.685293 16599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:40581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:33.685460 16599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:33.685701 16599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:33.690136 16605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:33.690261 16599 server_base.cc:1034] running on GCE node
W20260620 22:06:33.690160 16604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:33.690145 16607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:33.690682 16599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:33.690976 16599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:33.692128 16599 hybrid_clock.cc:648] HybridClock initialized: now 1781993193692127 us; error 33 us; skew 500 ppm
Jun 20 22:06:33 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:33.694312 16599 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:33.694718 16599 webserver.cc:460] Webserver started at http://127.1.55.254:42227/ using document root <none> and password file <none>
I20260620 22:06:33.694954 16599 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:33.695020 16599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:33.695161 16599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:33.696102 16599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "4c0fd647ee33400ba6ab844d7cf6c50a"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "fcc591d4b9d71075f55d5712c37a665d"
server_key_iv: "b27f0c417f4c453e2e44f279577ec089"
server_key_version: "encryptionkey@0"
I20260620 22:06:33.696442 16599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "4c0fd647ee33400ba6ab844d7cf6c50a"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "fcc591d4b9d71075f55d5712c37a665d"
server_key_iv: "b27f0c417f4c453e2e44f279577ec089"
server_key_version: "encryptionkey@0"
I20260620 22:06:33.697755 16599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:06:33.698421 16614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:33.698580 16599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:33.698678 16599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "4c0fd647ee33400ba6ab844d7cf6c50a"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "fcc591d4b9d71075f55d5712c37a665d"
server_key_iv: "b27f0c417f4c453e2e44f279577ec089"
server_key_version: "encryptionkey@0"
I20260620 22:06:33.698746 16599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:33.709153 16599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:33.711295 16599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:33.711449 16599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:33.715400 16599 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:40581
I20260620 22:06:33.715430 16666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:40581 every 8 connection(s)
I20260620 22:06:33.715730 16599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:33.716528 16667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:33.718508 16667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Bootstrap starting.
I20260620 22:06:33.718966 16667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:33.719194 16667 log.cc:824] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:33.719758 16667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: No bootstrap required, opened a new log
I20260620 22:06:33.720553 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 16599
I20260620 22:06:33.720670 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:06:33.720860 1247 external_mini_cluster.cc:1428] Setting key d6efbbfe93fd3a5fdf777d38e9504c77
I20260620 22:06:33.721503 16667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:06:33.721684 16667 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:33.721726 16667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0fd647ee33400ba6ab844d7cf6c50a, State: Initialized, Role: FOLLOWER
I20260620 22:06:33.721834 16667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:06:33.721925 16667 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:06:33.721958 16667 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:06:33.722029 16667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:33.722962 16667 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:06:33.723042 16667 leader_election.cc:302] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c0fd647ee33400ba6ab844d7cf6c50a; no voters:
I20260620 22:06:33.723213 16667 leader_election.cc:288] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:06:33.723242 16672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:33.723371 16672 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 1 LEADER]: Becoming Leader. State: Replica: 4c0fd647ee33400ba6ab844d7cf6c50a, State: Running, Role: LEADER
I20260620 22:06:33.723455 16667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:33.723501 16672 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:06:33.723892 16672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c0fd647ee33400ba6ab844d7cf6c50a. Latest consensus state: current_term: 1 leader_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } } }
I20260620 22:06:33.723902 16674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } } }
I20260620 22:06:33.724071 16672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:33.724182 16674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: This master's current role is: LEADER
W20260620 22:06:33.725157 16687 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:06:33.725208 16687 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:06:33.725257 16681 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:33.725409 16681 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:06:33.726902 16681 catalog_manager.cc:1347] Generated new cluster ID: 9da7c4ded5854180b08f7b95bb49be31
I20260620 22:06:33.726950 16681 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:06:33 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:33.731840 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:33.721344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34086 (local address 127.1.55.254:40581)
0620 22:06:33.721539 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:33.721547 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:33.721569 (+ 22us) server_negotiation.cc:407] Connection header received
0620 22:06:33.721665 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:33.721670 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:33.721720 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:33.721846 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:33.722622 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:33.723751 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:33.724794 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:33.725353 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:33.725457 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:33.728193 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:33.728196 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:33.728197 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:33.728207 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:33.730139 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:33.730563 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:33.730566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:33.730566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:33.730673 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:33.730925 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:33.730926 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:33.730926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:33.731186 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:33.731316 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:33.731440 (+ 124us) server_negotiation.cc:299] Negotiation successful
0620 22:06:33.731648 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":95,"threads_started":1}
I20260620 22:06:33.751879 16681 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:06:33.752554 16681 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:06:33.757651 16681 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Generated new TSK 0
I20260620 22:06:33.757800 16681 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:06:33.782600 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40581
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:33.859943 16693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:33.860107 16693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:33.860127 16693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:33.861223 16693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:33.861263 16693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:33.861316 16693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:06:33.862654 16693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:33.862875 16693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:33.863081 16693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:33.867601 16699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:33.867654 16698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:33.867681 16693 server_base.cc:1034] running on GCE node
W20260620 22:06:33.867647 16701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:33.868057 16693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:33.868309 16693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:33.869460 16693 hybrid_clock.cc:648] HybridClock initialized: now 1781993193869440 us; error 34 us; skew 500 ppm
Jun 20 22:06:33 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:33.871786 16693 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:06:33.872196 16693 webserver.cc:460] Webserver started at http://127.1.55.193:46441/ using document root <none> and password file <none>
I20260620 22:06:33.872407 16693 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:33.872466 16693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:33.872591 16693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:33.873446 16693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "fb368779368c45eb9e2171797db4193b"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "71b7c0a3557d605aca4535a969ded0e2"
server_key_iv: "8703c0274aecc3628b112294ddf67af9"
server_key_version: "encryptionkey@0"
I20260620 22:06:33.873862 16693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "fb368779368c45eb9e2171797db4193b"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "71b7c0a3557d605aca4535a969ded0e2"
server_key_iv: "8703c0274aecc3628b112294ddf67af9"
server_key_version: "encryptionkey@0"
I20260620 22:06:33.875087 16693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:33.875757 16708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:33.875926 16693 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:33.876014 16693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "fb368779368c45eb9e2171797db4193b"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "71b7c0a3557d605aca4535a969ded0e2"
server_key_iv: "8703c0274aecc3628b112294ddf67af9"
server_key_version: "encryptionkey@0"
I20260620 22:06:33.876091 16693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:33.892644 16693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:33.894333 16693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:33.894470 16693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:33.894654 16693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:33.894915 16693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:33.894965 16693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:33.894995 16693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:33.895015 16693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:33.900475 16693 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:33019
I20260620 22:06:33.900522 16821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:33019 every 8 connection(s)
I20260620 22:06:33.900785 16693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
Jun 20 22:06:33 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993193, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:33.906847 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 16693
I20260620 22:06:33.906962 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:06:33.907140 1247 external_mini_cluster.cc:1428] Setting key 5b9dea897f574a70e06f1f8343f4fac8
I20260620 22:06:33.909863 16824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:33.901442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:50259)
0620 22:06:33.901606 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:33.901667 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:33.902105 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:33.902361 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:33.902372 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:33.902892 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:33.903044 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:33.903048 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:33.903693 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:33.903694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:33.904477 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:33.904478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:33.904889 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:33.904890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:33.905003 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:33.905495 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:33.905502 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:33.906670 (+ 1168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:33.908411 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:33.908418 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:33.908420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:33.908725 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:33.908922 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:33.908923 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:33.908923 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:33.909068 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:33.909379 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:33.909384 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:33.909536 (+ 152us) client_negotiation.cc:769] Sending connection context
0620 22:06:33.909626 (+ 90us) client_negotiation.cc:240] Negotiation successful
0620 22:06:33.909730 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":101,"threads_started":1}
I20260620 22:06:33.909861 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:33.901412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:50259 (local address 127.1.55.254:40581)
0620 22:06:33.901514 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:33.901516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:33.901738 (+ 222us) server_negotiation.cc:407] Connection header received
0620 22:06:33.902206 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:33.902207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:33.902222 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:33.902279 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:33.903133 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:33.903599 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:33.904570 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:33.904800 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:33.904883 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:33.906768 (+ 1885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:33.906769 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:33.906769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:33.906774 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:33.908329 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:33.908801 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:33.908802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:33.908803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:33.908858 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:33.909144 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:33.909144 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:33.909145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:33.909294 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:33.909379 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:33.909668 (+ 289us) server_negotiation.cc:299] Negotiation successful
0620 22:06:33.909754 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260620 22:06:33.910461 16822 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40581
I20260620 22:06:33.910566 16822 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:33.910737 16822 heartbeater.cc:511] Master 127.1.55.254:40581 requested a full tablet report, sending...
I20260620 22:06:33.911154 16631 ts_manager.cc:194] Registered new tserver with Master: fb368779368c45eb9e2171797db4193b (127.1.55.193:33019)
I20260620 22:06:33.911810 16631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:50259
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:06:33.929975 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40581
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:34.003409 16827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:34.003602 16827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:34.003621 16827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:34.004695 16827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:34.004730 16827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:34.004755 16827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:06:34.006100 16827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:34.006264 16827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:34.006417 16827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:34.010941 16832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:34.010975 16833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:34.011000 16835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:34.011080 16827 server_base.cc:1034] running on GCE node
I20260620 22:06:34.011336 16827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:34.011587 16827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:34.012732 16827 hybrid_clock.cc:648] HybridClock initialized: now 1781993194012721 us; error 25 us; skew 500 ppm
Jun 20 22:06:34 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993194, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:34.015002 16827 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:06:34.015494 16827 webserver.cc:460] Webserver started at http://127.1.55.194:37387/ using document root <none> and password file <none>
I20260620 22:06:34.015713 16827 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:34.015781 16827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:34.015926 16827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:34.016875 16827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "e3f2896c24f440968eb2067356029f34"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "01fad412f60e9763cf1e6b7de30ed112"
server_key_iv: "1659a6209bd5c867745fdf18a8b8ee6a"
server_key_version: "encryptionkey@0"
I20260620 22:06:34.017216 16827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "e3f2896c24f440968eb2067356029f34"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "01fad412f60e9763cf1e6b7de30ed112"
server_key_iv: "1659a6209bd5c867745fdf18a8b8ee6a"
server_key_version: "encryptionkey@0"
I20260620 22:06:34.018651 16827 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:06:34.019318 16842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:34.019589 16827 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:34.019676 16827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "e3f2896c24f440968eb2067356029f34"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "01fad412f60e9763cf1e6b7de30ed112"
server_key_iv: "1659a6209bd5c867745fdf18a8b8ee6a"
server_key_version: "encryptionkey@0"
I20260620 22:06:34.019754 16827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:34.036505 16827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:34.038302 16827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:34.038455 16827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:34.038700 16827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:34.039059 16827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:34.039114 16827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:34.039145 16827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:34.039162 16827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:34.046707 16827 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:41309
I20260620 22:06:34.046756 16955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:41309 every 8 connection(s)
I20260620 22:06:34.047029 16827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
Jun 20 22:06:34 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993194, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:34.053805 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 16827
I20260620 22:06:34.053921 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:06:34.054093 1247 external_mini_cluster.cc:1428] Setting key 2bd0fe38dc24bd49e5344157c924fb38
I20260620 22:06:34.055312 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.047668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:39793 (local address 127.1.55.254:40581)
0620 22:06:34.047753 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.047755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.047911 (+ 156us) server_negotiation.cc:407] Connection header received
0620 22:06:34.048329 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.048330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.048340 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.048392 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:34.049211 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.049757 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.050655 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.050835 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.050882 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.052808 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:34.052809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:34.052809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:34.052815 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:34.054086 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:34.054496 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:34.054497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:34.054497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:34.054543 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:34.054757 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:34.054757 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:34.054758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:34.054871 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:34.054919 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.055194 (+ 275us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.055256 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 22:06:34.055577 16958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.047629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:39793)
0620 22:06:34.047798 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.047829 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:34.048247 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:34.048447 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:34.048450 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:34.048969 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:34.049140 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.049145 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.049823 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.049824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.050585 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.050587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.050905 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.050906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.050997 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.051470 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:34.051477 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:34.052728 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:34.054178 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:34.054184 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:34.054186 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:34.054427 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:34.054604 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:34.054604 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:34.054605 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:34.054703 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:34.054932 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:34.054938 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:34.055078 (+ 140us) client_negotiation.cc:769] Sending connection context
0620 22:06:34.055178 (+ 100us) client_negotiation.cc:240] Negotiation successful
0620 22:06:34.055329 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
I20260620 22:06:34.056404 16956 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40581
I20260620 22:06:34.056495 16956 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:34.056653 16956 heartbeater.cc:511] Master 127.1.55.254:40581 requested a full tablet report, sending...
I20260620 22:06:34.057076 16631 ts_manager.cc:194] Registered new tserver with Master: e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
I20260620 22:06:34.057559 16631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:39793
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:06:34.077608 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40581
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:34.155225 16961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:34.155398 16961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:34.155419 16961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:34.156435 16961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:34.156466 16961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:34.156487 16961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:06:34.157783 16961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:34.157954 16961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:34.158118 16961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:06:34.162765 16961 server_base.cc:1034] running on GCE node
W20260620 22:06:34.162892 16969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:34.162930 16967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:34.163110 16966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:34.163419 16961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:34.163709 16961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:34.164858 16961 hybrid_clock.cc:648] HybridClock initialized: now 1781993194164840 us; error 31 us; skew 500 ppm
Jun 20 22:06:34 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993194, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:34.168147 16961 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:06:34.168663 16961 webserver.cc:460] Webserver started at http://127.1.55.195:46325/ using document root <none> and password file <none>
I20260620 22:06:34.168937 16961 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:34.168998 16961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:34.169119 16961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:06:34.170447 16961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "ec6e4359c3be4ed3924849b8a204869a"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "a340aaad759ecf60f409ddd46abcf993"
server_key_iv: "6bff3fcb7bbf1be2414b888b35939eab"
server_key_version: "encryptionkey@0"
I20260620 22:06:34.170835 16961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "ec6e4359c3be4ed3924849b8a204869a"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "a340aaad759ecf60f409ddd46abcf993"
server_key_iv: "6bff3fcb7bbf1be2414b888b35939eab"
server_key_version: "encryptionkey@0"
I20260620 22:06:34.172577 16961 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260620 22:06:34.173780 16976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:34.173957 16961 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:34.174042 16961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "ec6e4359c3be4ed3924849b8a204869a"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "a340aaad759ecf60f409ddd46abcf993"
server_key_iv: "6bff3fcb7bbf1be2414b888b35939eab"
server_key_version: "encryptionkey@0"
I20260620 22:06:34.174110 16961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:34.203573 16961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:34.206167 16961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:34.206303 16961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:34.206522 16961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:34.206854 16961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:34.206903 16961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:34.206933 16961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:34.207005 16961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:34.212618 16961 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:40409
I20260620 22:06:34.212690 17089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:40409 every 8 connection(s)
I20260620 22:06:34.213004 16961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
Jun 20 22:06:34 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993194, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:34.221601 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.213684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:40393 (local address 127.1.55.254:40581)
0620 22:06:34.213724 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.213726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.213924 (+ 198us) server_negotiation.cc:407] Connection header received
0620 22:06:34.214371 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.214372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.214382 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.214433 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:34.215326 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.215874 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.216858 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.217031 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.217080 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.219178 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:34.219179 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:34.219180 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:34.219185 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:34.220483 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:34.220841 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:34.220842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:34.220842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:34.220888 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:34.221086 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:34.221087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:34.221087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:34.221177 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:34.221224 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.221438 (+ 214us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.221541 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:06:34.221750 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 16961
I20260620 22:06:34.221828 17092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.213673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:40393)
0620 22:06:34.213807 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.213844 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:34.214271 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:34.214479 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:34.214482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:34.215020 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:34.215257 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.215262 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.215977 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.215977 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.216788 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.216790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.217098 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.217099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.217208 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.217763 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:34.217770 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:34.219101 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:34.220572 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:34.220577 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:34.220579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:34.220772 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:34.220945 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:34.220945 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:34.220945 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:34.221032 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:34.221229 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:34.221233 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:34.221335 (+ 102us) client_negotiation.cc:769] Sending connection context
0620 22:06:34.221411 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 22:06:34.221589 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":78,"threads_started":1}
I20260620 22:06:34.221868 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:06:34.222054 1247 external_mini_cluster.cc:1428] Setting key 896a80875fb4e54ade23f7fe4096d3b9
I20260620 22:06:34.222491 17090 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40581
I20260620 22:06:34.222575 17090 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:34.222783 17090 heartbeater.cc:511] Master 127.1.55.254:40581 requested a full tablet report, sending...
I20260620 22:06:34.223270 16631 ts_manager.cc:194] Registered new tserver with Master: ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409)
I20260620 22:06:34.223721 16631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:40393
I20260620 22:06:34.233835 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:06:34.240064 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.234976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34102 (local address 127.1.55.254:40581)
0620 22:06:34.235034 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.235036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.235076 (+ 40us) server_negotiation.cc:407] Connection header received
0620 22:06:34.235109 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.235109 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.235117 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.235153 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:34.235635 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.236088 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.236731 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.236897 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.236944 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.237945 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:34.237946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:34.237946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:34.237951 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:34.239242 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:34.239512 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:34.239513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:34.239513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:34.239557 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:34.239678 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:34.239679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:34.239679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:34.239782 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:34.239847 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.239937 (+ 90us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.239986 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260620 22:06:34.241425 16631 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:06:34.242818 16631 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:06:34.248602 17098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.244637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41309 (local address 127.0.0.1:33316)
0620 22:06:34.245520 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.245529 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:34.245573 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:34.245829 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:34.245829 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:34.245831 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:34.245862 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.245863 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.246831 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.246832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.247642 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.247645 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.248301 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.248302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.248378 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.248390 (+ 12us) client_negotiation.cc:769] Sending connection context
0620 22:06:34.248485 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 22:06:34.248534 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":873,"thread_start_us":42,"threads_started":1}
I20260620 22:06:34.248611 17102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.244874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33316 (local address 127.1.55.194:41309)
0620 22:06:34.245010 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.245013 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.245625 (+ 612us) server_negotiation.cc:407] Connection header received
0620 22:06:34.245666 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.245668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.245681 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.245754 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:34.245924 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.246716 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.247724 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.248199 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.248281 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.248337 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.248501 (+ 164us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.248539 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260620 22:06:34.248936 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.244768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40134 (local address 127.1.55.195:40409)
0620 22:06:34.244946 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.244951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.245119 (+ 168us) server_negotiation.cc:407] Connection header received
0620 22:06:34.245215 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.245217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.245230 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.245275 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:34.245536 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.246217 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.247711 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.248414 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.248486 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.248539 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.248802 (+ 263us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.248852 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260620 22:06:34.248754 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.244621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33019 (local address 127.0.0.1:37588)
0620 22:06:34.244758 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.244793 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:34.244883 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:34.245182 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:34.245184 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:34.245186 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:34.245227 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.245228 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.246453 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.246453 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.247608 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.247612 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.248519 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.248520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.248593 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.248597 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:34.248627 (+ 30us) client_negotiation.cc:240] Negotiation successful
0620 22:06:34.248673 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":9,"thread_start_us":46,"threads_started":1}
I20260620 22:06:34.248764 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.244633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40409 (local address 127.0.0.1:40134)
0620 22:06:34.245060 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.245069 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:34.245127 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:34.245356 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:34.245356 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:34.245358 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:34.245402 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.245403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.246312 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.246313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.247611 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.247612 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.248567 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.248568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.248620 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.248624 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:34.248669 (+ 45us) client_negotiation.cc:240] Negotiation successful
0620 22:06:34.248699 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":4,"thread_start_us":66,"threads_started":1}
I20260620 22:06:34.249091 17103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.244895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37588 (local address 127.1.55.193:33019)
0620 22:06:34.245029 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.245032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.245042 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:06:34.245080 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.245084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.245097 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.245180 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:34.245273 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.246365 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.247727 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.248428 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.248843 (+ 415us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.248919 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.248944 (+ 25us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.249001 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260620 22:06:34.249693 17024 tablet_service.cc:1467] Processing CreateTablet for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 (DEFAULT_TABLE table=test-table [id=4828bb69e95f492ebeec508881af476f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:34.249691 16756 tablet_service.cc:1467] Processing CreateTablet for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 (DEFAULT_TABLE table=test-table [id=4828bb69e95f492ebeec508881af476f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:34.249882 16890 tablet_service.cc:1467] Processing CreateTablet for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 (DEFAULT_TABLE table=test-table [id=4828bb69e95f492ebeec508881af476f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:34.249989 16756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:34.249989 17024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:34.250141 16890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:34.252990 17104 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Bootstrap starting.
I20260620 22:06:34.253284 17105 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Bootstrap starting.
I20260620 22:06:34.253458 17106 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Bootstrap starting.
I20260620 22:06:34.253635 17104 tablet_bootstrap.cc:654] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:34.253887 17105 tablet_bootstrap.cc:654] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:34.254143 17106 tablet_bootstrap.cc:654] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:34.254205 17104 log.cc:824] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:34.254383 17105 log.cc:824] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:34.254724 17106 log.cc:824] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:34.254978 17104 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: No bootstrap required, opened a new log
I20260620 22:06:34.255049 17104 ts_tablet_manager.cc:1397] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:06:34.255322 17106 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: No bootstrap required, opened a new log
I20260620 22:06:34.255373 17106 ts_tablet_manager.cc:1397] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:34.256448 17104 raft_consensus.cc:348] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.256588 17104 raft_consensus.cc:374] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:34.256646 17104 raft_consensus.cc:729] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f2896c24f440968eb2067356029f34, State: Initialized, Role: FOLLOWER
I20260620 22:06:34.256764 17104 consensus_queue.cc:260] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.256846 17106 raft_consensus.cc:348] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.257011 17106 raft_consensus.cc:374] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:34.257058 17106 raft_consensus.cc:729] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6e4359c3be4ed3924849b8a204869a, State: Initialized, Role: FOLLOWER
I20260620 22:06:34.257097 17104 ts_tablet_manager.cc:1428] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:06:34.257093 16956 heartbeater.cc:503] Master 127.1.55.254:40581 was elected leader, sending a full tablet report...
I20260620 22:06:34.257169 17106 consensus_queue.cc:260] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.257464 17090 heartbeater.cc:503] Master 127.1.55.254:40581 was elected leader, sending a full tablet report...
I20260620 22:06:34.257463 17106 ts_tablet_manager.cc:1428] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:34.257719 17105 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: No bootstrap required, opened a new log
I20260620 22:06:34.257772 17105 ts_tablet_manager.cc:1397] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260620 22:06:34.259207 17105 raft_consensus.cc:348] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.259321 17105 raft_consensus.cc:374] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:34.259342 17105 raft_consensus.cc:729] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb368779368c45eb9e2171797db4193b, State: Initialized, Role: FOLLOWER
I20260620 22:06:34.259404 17105 consensus_queue.cc:260] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.259613 17105 ts_tablet_manager.cc:1428] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:34.259639 16822 heartbeater.cc:503] Master 127.1.55.254:40581 was elected leader, sending a full tablet report...
W20260620 22:06:34.297669 16957 tablet.cc:2369] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:06:34.401434 16823 tablet.cc:2369] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:06:34.463519 17091 tablet.cc:2369] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:06:34.606434 17110 raft_consensus.cc:482] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:34.606562 17110 raft_consensus.cc:504] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.606892 17110 leader_election.cc:288] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb368779368c45eb9e2171797db4193b (127.1.55.193:33019), ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409)
I20260620 22:06:34.609858 17101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.607173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:56285 (local address 127.1.55.195:40409)
0620 22:06:34.607222 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.607224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.607314 (+ 90us) server_negotiation.cc:407] Connection header received
0620 22:06:34.607398 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.607400 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.607408 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.607479 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:34.607638 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.608128 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.609084 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.609444 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.609568 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.609577 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.609754 (+ 177us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.609790 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:06:34.609871 17103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.607222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:37621 (local address 127.1.55.193:33019)
0620 22:06:34.607270 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.607272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.607284 (+ 12us) server_negotiation.cc:407] Connection header received
0620 22:06:34.607392 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.607393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.607406 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.607474 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:34.607635 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.608192 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.609113 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.609452 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.609599 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.609608 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.609749 (+ 141us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.609791 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:06:34.609900 17113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.607087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40409 (local address 127.1.55.194:56285)
0620 22:06:34.607229 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.607240 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:34.607332 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:34.607481 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:34.607482 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:34.607484 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:34.607557 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.607563 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.608210 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.608211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.608989 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.608991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.609581 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.609582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.609664 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.609667 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:06:34.609745 (+ 78us) client_negotiation.cc:240] Negotiation successful
0620 22:06:34.609790 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260620 22:06:34.609902 17114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.607087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33019 (local address 127.1.55.194:37621)
0620 22:06:34.607237 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.607247 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:34.607302 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:34.607489 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:34.607490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:34.607492 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:34.607567 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.607569 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.608284 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.608285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.609021 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:34.609022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.609601 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.609602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:34.609676 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.609679 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:06:34.609744 (+ 65us) client_negotiation.cc:240] Negotiation successful
0620 22:06:34.609793 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":16,"thread_start_us":67,"threads_started":1}
I20260620 22:06:34.610242 17044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f3eb3ea0f7b4092b8c33a3ac2acda50" candidate_uuid: "e3f2896c24f440968eb2067356029f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6e4359c3be4ed3924849b8a204869a" is_pre_election: true
I20260620 22:06:34.610293 16776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f3eb3ea0f7b4092b8c33a3ac2acda50" candidate_uuid: "e3f2896c24f440968eb2067356029f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb368779368c45eb9e2171797db4193b" is_pre_election: true
I20260620 22:06:34.610409 17044 raft_consensus.cc:2454] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f2896c24f440968eb2067356029f34 in term 0.
I20260620 22:06:34.610483 16776 raft_consensus.cc:2454] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f2896c24f440968eb2067356029f34 in term 0.
I20260620 22:06:34.610627 16843 leader_election.cc:302] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3f2896c24f440968eb2067356029f34, ec6e4359c3be4ed3924849b8a204869a; no voters:
I20260620 22:06:34.610781 17110 raft_consensus.cc:2781] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:06:34.610826 17110 raft_consensus.cc:482] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:06:34.610842 17110 raft_consensus.cc:3037] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:34.611492 17110 raft_consensus.cc:504] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.611624 17110 leader_election.cc:288] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [CANDIDATE]: Term 1 election: Requested vote from peers fb368779368c45eb9e2171797db4193b (127.1.55.193:33019), ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409)
I20260620 22:06:34.611775 16776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f3eb3ea0f7b4092b8c33a3ac2acda50" candidate_uuid: "e3f2896c24f440968eb2067356029f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb368779368c45eb9e2171797db4193b"
I20260620 22:06:34.611809 17044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f3eb3ea0f7b4092b8c33a3ac2acda50" candidate_uuid: "e3f2896c24f440968eb2067356029f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec6e4359c3be4ed3924849b8a204869a"
I20260620 22:06:34.611848 16776 raft_consensus.cc:3037] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:34.611879 17044 raft_consensus.cc:3037] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:34.612671 16776 raft_consensus.cc:2454] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f2896c24f440968eb2067356029f34 in term 1.
I20260620 22:06:34.612671 17044 raft_consensus.cc:2454] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f2896c24f440968eb2067356029f34 in term 1.
I20260620 22:06:34.612890 16846 leader_election.cc:302] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3f2896c24f440968eb2067356029f34, fb368779368c45eb9e2171797db4193b; no voters:
I20260620 22:06:34.612977 17110 raft_consensus.cc:2781] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:34.613181 17110 raft_consensus.cc:686] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 LEADER]: Becoming Leader. State: Replica: e3f2896c24f440968eb2067356029f34, State: Running, Role: LEADER
I20260620 22:06:34.613270 17110 consensus_queue.cc:237] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:34.614133 16631 catalog_manager.cc:5495] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f2896c24f440968eb2067356029f34 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "e3f2896c24f440968eb2067356029f34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } health_report { overall_health: HEALTHY } } }
I20260620 22:06:34.685299 17102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.683424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33326 (local address 127.1.55.194:41309)
0620 22:06:34.683480 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:34.683481 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:34.683489 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:34.683514 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:34.683515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:34.683528 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:34.683582 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:06:34.683707 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.684130 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.684764 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:34.684918 (+ 154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:34.684961 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:34.685074 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:06:34.685157 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:06:34.685210 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:34.685241 (+ 31us) server_negotiation.cc:299] Negotiation successful
0620 22:06:34.685254 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260620 22:06:34.686735 17044 raft_consensus.cc:1261] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 1 FOLLOWER]: Refusing update from remote peer e3f2896c24f440968eb2067356029f34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:34.686735 16776 raft_consensus.cc:1261] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Refusing update from remote peer e3f2896c24f440968eb2067356029f34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:34.687076 17115 consensus_queue.cc:1035] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:34.687196 17110 consensus_queue.cc:1035] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:34.689612 17120 mvcc.cc:205] Tried to move back new op lower bound from 7299044125434716160 to 7299044125136580608. Current Snapshot: MvccSnapshot[applied={T|T < 7299044125434716160}]
I20260620 22:06:34.690269 17119 mvcc.cc:205] Tried to move back new op lower bound from 7299044125434716160 to 7299044125136580608. Current Snapshot: MvccSnapshot[applied={T|T < 7299044125434716160}]
I20260620 22:06:34.691370 16631 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:34.691459 16631 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:34.692162 16631 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Sending DeleteTablet for 3 replicas of tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50
I20260620 22:06:34.692436 16890 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:34 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:33316
I20260620 22:06:34.692467 16756 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:34 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:37588
I20260620 22:06:34.692555 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 16693
I20260620 22:06:34.694463 17024 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:34 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:40134
W20260620 22:06:34.697225 16618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:33019 (error 108)
I20260620 22:06:34.697455 17129 tablet_replica.cc:330] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: stopping tablet replica
I20260620 22:06:34.697561 17129 raft_consensus.cc:2229] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:06:34.697593 17130 tablet_replica.cc:330] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: stopping tablet replica
I20260620 22:06:34.697678 17098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.697576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33019 (local address 127.0.0.1:37594)
0620 22:06:34.697621 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.697650 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260620 22:06:34.697682 17130 raft_consensus.cc:2229] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:34.697711 17129 raft_consensus.cc:2258] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:34.697778 17130 raft_consensus.cc:2258] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:34.697865 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 16827
W20260620 22:06:34.697949 16618 catalog_manager.cc:4584] TS fb368779368c45eb9e2171797db4193b (127.1.55.193:33019): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33019: connect: Connection refused (error 111)
I20260620 22:06:34.699186 17130 ts_tablet_manager.cc:1905] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:34.701026 17130 ts_tablet_manager.cc:1918] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:34.701121 17130 log.cc:1196] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/8f3eb3ea0f7b4092b8c33a3ac2acda50
I20260620 22:06:34.701359 17130 ts_tablet_manager.cc:1939] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P ec6e4359c3be4ed3924849b8a204869a: Deleting consensus metadata
I20260620 22:06:34.701757 16615 catalog_manager.cc:4841] TS ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409): tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 (table test-table [id=4828bb69e95f492ebeec508881af476f]) successfully deleted
I20260620 22:06:34.703648 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 16961
I20260620 22:06:34.703691 17098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:34.703610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41309 (local address 127.0.0.1:33330)
0620 22:06:34.703641 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:34.703661 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.194:41309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260620 22:06:34.707798 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 16599
I20260620 22:06:54.713023 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40581
--webserver_interface=127.1.55.254
--webserver_port=42227
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:40581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:06:54.787132 17132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:54.787309 17132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:54.787329 17132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:54.788421 17132 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260620 22:06:54.788460 17132 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260620 22:06:54.788473 17132 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260620 22:06:54.788484 17132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:06:54.788538 17132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:54.788556 17132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:54.788578 17132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:06:54.788606 17132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:06:54.790069 17132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:40581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=42227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:54.790277 17132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:54.790515 17132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:54.798362 17138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:54.798501 17132 server_base.cc:1034] running on GCE node
W20260620 22:06:54.798369 17139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:54.798534 17141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:54.798864 17132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:54.799146 17132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:54.800300 17132 hybrid_clock.cc:648] HybridClock initialized: now 1781993214800296 us; error 33 us; skew 500 ppm
Jun 20 22:06:54 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993214, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:54.802672 17132 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:06:54.803079 17132 webserver.cc:460] Webserver started at http://127.1.55.254:42227/ using document root <none> and password file <none>
I20260620 22:06:54.803308 17132 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:54.803366 17132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:54.804641 17132 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:54.805209 17148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:54.805359 17132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:06:54.805436 17132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "4c0fd647ee33400ba6ab844d7cf6c50a"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "fcc591d4b9d71075f55d5712c37a665d"
server_key_iv: "b27f0c417f4c453e2e44f279577ec089"
server_key_version: "encryptionkey@0"
I20260620 22:06:54.805785 17132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:54.826422 17132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:54.828032 17132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:54.828126 17132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:54.831645 17132 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:40581
I20260620 22:06:54.831673 17200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:40581 every 8 connection(s)
I20260620 22:06:54.832039 17132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:06:54.833387 17201 sys_catalog.cc:263] Verifying existing consensus state
I20260620 22:06:54.834065 17201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Bootstrap starting.
I20260620 22:06:54.837631 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 17132
I20260620 22:06:54.837939 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:33019
--local_ip_for_outbound_sockets=127.1.55.193
--tserver_master_addrs=127.1.55.254:40581
--webserver_port=46441
--webserver_interface=127.1.55.193
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:54.842137 17201 log.cc:824] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:54.843789 17201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:06:54.844054 17201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Bootstrap complete.
I20260620 22:06:54.846040 17201 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:06:54.846246 17201 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0fd647ee33400ba6ab844d7cf6c50a, State: Initialized, Role: FOLLOWER
I20260620 22:06:54.846402 17201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:06:54.846470 17201 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:06:54.846520 17201 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:06:54.846565 17201 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 1 FOLLOWER]: Advancing to term 2
I20260620 22:06:54.847407 17201 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:06:54.847529 17201 leader_election.cc:302] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c0fd647ee33400ba6ab844d7cf6c50a; no voters:
I20260620 22:06:54.847712 17201 leader_election.cc:288] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260620 22:06:54.847752 17205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 2 FOLLOWER]: Leader election won for term 2
I20260620 22:06:54.847894 17205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 2 LEADER]: Becoming Leader. State: Replica: 4c0fd647ee33400ba6ab844d7cf6c50a, State: Running, Role: LEADER
I20260620 22:06:54.848007 17201 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:06:54.848031 17205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:06:54.848347 17205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c0fd647ee33400ba6ab844d7cf6c50a. Latest consensus state: current_term: 2 leader_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } } }
I20260620 22:06:54.848438 17205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:54.848340 17206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } } }
I20260620 22:06:54.848659 17206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: This master's current role is: LEADER
I20260620 22:06:54.848719 17211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:06:54.849627 17211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:06:54.849784 17211 catalog_manager.cc:1259] Loaded cluster ID: 9da7c4ded5854180b08f7b95bb49be31
I20260620 22:06:54.849967 17211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:06:54.850695 17211 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:06:54.850869 17211 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Loaded TSK: 0
I20260620 22:06:54.863404 17211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Generated new TSK 1
I20260620 22:06:54.863480 17211 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 22:06:54.930200 17203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:54.930400 17203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:54.930437 17203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:54.931499 17203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:54.931569 17203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:54.931610 17203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:06:54.933048 17203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:33019
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=46441
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:54.933281 17203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:54.933564 17203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:54.938154 17231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:54.938217 17229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:54.938337 17203 server_base.cc:1034] running on GCE node
W20260620 22:06:54.938309 17228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:54.938586 17203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:54.938839 17203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:54.940009 17203 hybrid_clock.cc:648] HybridClock initialized: now 1781993214939986 us; error 35 us; skew 500 ppm
Jun 20 22:06:54 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993214, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:54.942663 17203 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:06:54.943064 17203 webserver.cc:460] Webserver started at http://127.1.55.193:46441/ using document root <none> and password file <none>
I20260620 22:06:54.943269 17203 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:54.943353 17203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:54.944571 17203 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:54.945283 17238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:54.945446 17203 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:54.945542 17203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "fb368779368c45eb9e2171797db4193b"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "71b7c0a3557d605aca4535a969ded0e2"
server_key_iv: "8703c0274aecc3628b112294ddf67af9"
server_key_version: "encryptionkey@0"
I20260620 22:06:54.945811 17203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:54.960235 17203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:54.962342 17203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:54.962487 17203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:54.962734 17203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:54.963198 17245 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 22:06:54.964568 17203 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 22:06:54.964615 17203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260620 22:06:54.964649 17203 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 22:06:54.965235 17203 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 22:06:54.965277 17203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:54.965320 17245 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Bootstrap starting.
I20260620 22:06:54.972361 17203 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:33019
I20260620 22:06:54.972435 17352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:33019 every 8 connection(s)
I20260620 22:06:54.972843 17203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:06:54.973011 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 17203
I20260620 22:06:54.973301 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:41309
--local_ip_for_outbound_sockets=127.1.55.194
--tserver_master_addrs=127.1.55.254:40581
--webserver_port=37387
--webserver_interface=127.1.55.194
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:54.976712 17245 log.cc:824] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:54.979207 17245 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:06:54.979561 17245 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Bootstrap complete.
I20260620 22:06:54.980670 17245 ts_tablet_manager.cc:1397] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260620 22:06:54.981910 17245 raft_consensus.cc:348] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:54.982256 17245 raft_consensus.cc:729] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb368779368c45eb9e2171797db4193b, State: Initialized, Role: FOLLOWER
I20260620 22:06:54.982489 17245 consensus_queue.cc:260] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:54.982791 17245 ts_tablet_manager.cc:1428] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Jun 20 22:06:54 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993214, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:54.987252 17355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:54.974037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:35521)
0620 22:06:54.974220 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:54.974255 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:54.974877 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:54.976539 (+ 1662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:54.976543 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:54.976844 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:54.977059 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:54.977064 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:54.978764 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:54.978765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:54.980112 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:54.980117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:54.980947 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:54.980948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:54.981115 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:54.981708 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:54.981718 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:54.983551 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:54.985721 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:54.985728 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:54.985729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:54.986012 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:54.986284 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:54.986285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:54.986285 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:54.986392 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:54.986738 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:54.986743 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:54.986868 (+ 125us) client_negotiation.cc:769] Sending connection context
0620 22:06:54.986960 (+ 92us) client_negotiation.cc:240] Negotiation successful
0620 22:06:54.987088 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":122,"threads_started":1}
I20260620 22:06:54.987278 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:54.974325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:35521 (local address 127.1.55.254:40581)
0620 22:06:54.976079 (+ 1754us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:54.976087 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:54.976119 (+ 32us) server_negotiation.cc:407] Connection header received
0620 22:06:54.976230 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:54.976235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:54.976291 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:54.976412 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:54.977185 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:54.978594 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:54.980228 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:54.980813 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:54.983044 (+ 2231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:54.983695 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:54.983698 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:54.983699 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:54.983713 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:54.985647 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:54.986096 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:54.986099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:54.986099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:54.986203 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:54.986454 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:54.986455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:54.986455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:54.986676 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:54.986745 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:54.987013 (+ 268us) server_negotiation.cc:299] Negotiation successful
0620 22:06:54.987125 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1711,"thread_start_us":73,"threads_started":1}
I20260620 22:06:54.988337 17353 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40581
I20260620 22:06:54.988430 17353 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:54.988581 17353 heartbeater.cc:511] Master 127.1.55.254:40581 requested a full tablet report, sending...
I20260620 22:06:54.989212 17165 ts_manager.cc:194] Registered new tserver with Master: fb368779368c45eb9e2171797db4193b (127.1.55.193:33019)
I20260620 22:06:54.990243 17165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:35521
I20260620 22:06:54.991163 17353 heartbeater.cc:503] Master 127.1.55.254:40581 was elected leader, sending a full tablet report...
I20260620 22:06:54.995931 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:54.989950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40520 (local address 127.1.55.193:33019)
0620 22:06:54.993115 (+ 3165us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:54.993119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:54.993127 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:54.993154 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:54.993155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:54.993167 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:54.993281 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:54.993432 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:54.994089 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:54.995138 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:54.995550 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:54.995642 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:54.995693 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:54.995833 (+ 140us) server_negotiation.cc:299] Negotiation successful
0620 22:06:54.995866 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3140,"thread_start_us":59,"threads_started":1}
I20260620 22:06:54.995931 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:54.989788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33019 (local address 127.0.0.1:40520)
0620 22:06:54.989932 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:54.989967 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:54.990022 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:54.993290 (+ 3268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:54.993293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:54.993295 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:54.993350 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:54.993352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:54.994173 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:54.994174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:54.995021 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:54.995023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:54.995645 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:54.995646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:54.995722 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:54.995734 (+ 12us) client_negotiation.cc:769] Sending connection context
0620 22:06:54.995818 (+ 84us) client_negotiation.cc:240] Negotiation successful
0620 22:06:54.995867 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":76,"threads_started":1}
I20260620 22:06:54.996346 17287 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:34 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:40520
I20260620 22:06:54.996759 17362 tablet_replica.cc:330] stopping tablet replica
I20260620 22:06:54.996853 17362 raft_consensus.cc:2229] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:54.996906 17362 raft_consensus.cc:2258] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:54.997144 17362 ts_tablet_manager.cc:1905] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:54.999390 17362 ts_tablet_manager.cc:1918] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:54.999459 17362 log.cc:1196] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal/wals/8f3eb3ea0f7b4092b8c33a3ac2acda50
I20260620 22:06:54.999677 17362 ts_tablet_manager.cc:1939] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P fb368779368c45eb9e2171797db4193b: Deleting consensus metadata
I20260620 22:06:55.000115 17152 catalog_manager.cc:4841] TS fb368779368c45eb9e2171797db4193b (127.1.55.193:33019): tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 (table test-table [id=4828bb69e95f492ebeec508881af476f]) successfully deleted
W20260620 22:06:55.056442 17357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:55.056612 17357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:55.056632 17357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:55.057746 17357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:55.057785 17357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:55.057807 17357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:06:55.059142 17357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:41309
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=37387
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:55.059363 17357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:55.059571 17357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:55.064283 17368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:55.064307 17370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:55.064307 17367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:55.064538 17357 server_base.cc:1034] running on GCE node
I20260620 22:06:55.064750 17357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:55.065002 17357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:55.066130 17357 hybrid_clock.cc:648] HybridClock initialized: now 1781993215066120 us; error 26 us; skew 500 ppm
Jun 20 22:06:55 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993215, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:55.068363 17357 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:06:55.068738 17357 webserver.cc:460] Webserver started at http://127.1.55.194:37387/ using document root <none> and password file <none>
I20260620 22:06:55.068950 17357 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:55.069036 17357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:55.070250 17357 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:55.070806 17377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:55.070966 17357 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:55.071048 17357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "e3f2896c24f440968eb2067356029f34"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "01fad412f60e9763cf1e6b7de30ed112"
server_key_iv: "1659a6209bd5c867745fdf18a8b8ee6a"
server_key_version: "encryptionkey@0"
I20260620 22:06:55.071297 17357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:55.082748 17357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:55.084321 17357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:55.084460 17357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:55.084642 17357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:55.085016 17384 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 22:06:55.086215 17357 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 22:06:55.086282 17357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:55.086320 17357 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 22:06:55.086856 17357 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 22:06:55.086932 17357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:55.086951 17384 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Bootstrap starting.
I20260620 22:06:55.093078 17357 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:41309
I20260620 22:06:55.093144 17491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:41309 every 8 connection(s)
I20260620 22:06:55.094357 17357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:06:55.096367 17384 log.cc:824] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:55.098480 17384 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:06:55.098742 17384 tablet_bootstrap.cc:492] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Bootstrap complete.
I20260620 22:06:55.098747 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 17357
I20260620 22:06:55.098969 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:40409
--local_ip_for_outbound_sockets=127.1.55.195
--tserver_master_addrs=127.1.55.254:40581
--webserver_port=46325
--webserver_interface=127.1.55.195
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:06:55.099778 17384 ts_tablet_manager.cc:1397] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260620 22:06:55.101132 17384 raft_consensus.cc:348] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.101385 17384 raft_consensus.cc:729] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f2896c24f440968eb2067356029f34, State: Initialized, Role: FOLLOWER
I20260620 22:06:55.101521 17384 consensus_queue.cc:260] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
Jun 20 22:06:55 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993215, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:55.101769 17384 ts_tablet_manager.cc:1428] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
I20260620 22:06:55.105189 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.094957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:43397 (local address 127.1.55.254:40581)
0620 22:06:55.095023 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.095025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.096659 (+ 1634us) server_negotiation.cc:407] Connection header received
0620 22:06:55.097186 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.097187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.097198 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.097244 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:55.097886 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.098301 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.099703 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.100014 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.100080 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.102279 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:55.102280 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:55.102281 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:55.102287 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:55.103767 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.104276 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.104277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.104277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.104323 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.104595 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.104596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.104596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.104685 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:55.104732 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.105064 (+ 332us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.105128 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 22:06:55.105513 17494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.094880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:43397)
0620 22:06:55.096529 (+ 1649us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:55.096567 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:55.097095 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:55.097291 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:55.097295 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:55.097607 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:55.097811 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.097816 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.098393 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.098394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.099620 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.099623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.100167 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.100168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.100305 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.100788 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:55.100795 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:55.102198 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:55.103878 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:55.103885 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:55.103887 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:55.104202 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:55.104384 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:55.104384 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:55.104385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:55.104523 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:55.104745 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:55.104750 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:55.104925 (+ 175us) client_negotiation.cc:769] Sending connection context
0620 22:06:55.105047 (+ 122us) client_negotiation.cc:240] Negotiation successful
0620 22:06:55.105227 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1611,"thread_start_us":101,"threads_started":1}
I20260620 22:06:55.105988 17492 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40581
I20260620 22:06:55.106086 17492 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:55.106259 17492 heartbeater.cc:511] Master 127.1.55.254:40581 requested a full tablet report, sending...
I20260620 22:06:55.106752 17165 ts_manager.cc:194] Registered new tserver with Master: e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
I20260620 22:06:55.107256 17165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:43397
I20260620 22:06:55.107985 17492 heartbeater.cc:503] Master 127.1.55.254:40581 was elected leader, sending a full tablet report...
Jun 20 22:06:55 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993214, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.194@KRBTEST.COM
I20260620 22:06:55.114617 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.107197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60754 (local address 127.1.55.194:41309)
0620 22:06:55.107343 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.107348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.107358 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:06:55.107389 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.107391 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.107404 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.107478 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:55.107938 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.109076 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.109792 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.110281 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.110368 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.112092 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:55.112097 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:55.112098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:55.112103 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:55.113539 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.113967 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.113969 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.113969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.114021 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.114198 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.114198 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.114198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.114305 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:55.114360 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.114507 (+ 147us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.114566 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":65,"threads_started":1}
I20260620 22:06:55.114660 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.107031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41309 (local address 127.0.0.1:60754)
0620 22:06:55.107091 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:55.107100 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:55.107137 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:55.107476 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:55.107477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:55.107816 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:55.107851 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.107853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.109154 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.109154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.109721 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.109723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.110367 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.110367 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.110403 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.110807 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:55.110811 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:55.112015 (+ 1204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:55.113607 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:55.113613 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:55.113615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:55.113891 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:55.114080 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:55.114081 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:55.114081 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:55.114141 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:55.114364 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:55.114370 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:55.114417 (+ 47us) client_negotiation.cc:769] Sending connection context
0620 22:06:55.114487 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 22:06:55.114572 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260620 22:06:55.115283 17426 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:34 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:60754
I20260620 22:06:55.115672 17499 tablet_replica.cc:330] stopping tablet replica
I20260620 22:06:55.115767 17499 raft_consensus.cc:2229] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:55.115823 17499 raft_consensus.cc:2258] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:55.116045 17499 ts_tablet_manager.cc:1905] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:55.118012 17499 ts_tablet_manager.cc:1918] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:55.118064 17499 log.cc:1196] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/8f3eb3ea0f7b4092b8c33a3ac2acda50
I20260620 22:06:55.118260 17499 ts_tablet_manager.cc:1939] T 8f3eb3ea0f7b4092b8c33a3ac2acda50 P e3f2896c24f440968eb2067356029f34: Deleting consensus metadata
I20260620 22:06:55.118641 17150 catalog_manager.cc:4841] TS e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309): tablet 8f3eb3ea0f7b4092b8c33a3ac2acda50 (table test-table [id=4828bb69e95f492ebeec508881af476f]) successfully deleted
W20260620 22:06:55.180380 17496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:06:55.180563 17496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:06:55.180596 17496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:06:55.181627 17496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:06:55.181675 17496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:06:55.181711 17496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:06:55.182992 17496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:40409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=46325
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:06:55.183225 17496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:06:55.183439 17496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:06:55.187762 17507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:55.188033 17496 server_base.cc:1034] running on GCE node
W20260620 22:06:55.187778 17505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:06:55.187855 17504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:06:55.188378 17496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:06:55.188555 17496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:06:55.189705 17496 hybrid_clock.cc:648] HybridClock initialized: now 1781993215189690 us; error 26 us; skew 500 ppm
Jun 20 22:06:55 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993215, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:06:55.191910 17496 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:06:55.192301 17496 webserver.cc:460] Webserver started at http://127.1.55.195:46325/ using document root <none> and password file <none>
I20260620 22:06:55.192517 17496 fs_manager.cc:359] Metadata directory not provided
I20260620 22:06:55.192595 17496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:06:55.193857 17496 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:06:55.194363 17514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:55.194511 17496 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:06:55.194597 17496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "ec6e4359c3be4ed3924849b8a204869a"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "a340aaad759ecf60f409ddd46abcf993"
server_key_iv: "6bff3fcb7bbf1be2414b888b35939eab"
server_key_version: "encryptionkey@0"
I20260620 22:06:55.194881 17496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:06:55.212153 17496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:06:55.214341 17496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:06:55.214493 17496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:06:55.214704 17496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:06:55.214963 17496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:06:55.215013 17496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:55.215045 17496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:06:55.215070 17496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:55.220383 17496 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:40409
I20260620 22:06:55.220419 17627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:40409 every 8 connection(s)
I20260620 22:06:55.220705 17496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:06:55.224442 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 17496
Jun 20 22:06:55 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993215, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:06:55.229414 17356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.221303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:47803 (local address 127.1.55.254:40581)
0620 22:06:55.221350 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.221352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.221556 (+ 204us) server_negotiation.cc:407] Connection header received
0620 22:06:55.221993 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.221994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.222007 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.222055 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:55.222918 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.223401 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.224348 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.224550 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.224614 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.226729 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:55.226730 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:55.226730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:55.226735 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:55.228049 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.228464 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.228465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.228466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.228523 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.228769 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.228771 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.228771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.228907 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:55.229008 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.229241 (+ 233us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.229335 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:06:55.229652 17630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.221266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:47803)
0620 22:06:55.221406 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:55.221447 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:55.221885 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:55.222109 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:55.222112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:55.222645 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:06:55.222808 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.222811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.223490 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.223491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.224237 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.224239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.224634 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.224636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.224749 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.225193 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:06:55.225203 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:06:55.226647 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:06:55.228144 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:55.228150 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:55.228152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:55.228367 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:55.228591 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:06:55.228592 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:06:55.228592 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:06:55.228699 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:06:55.228988 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:06:55.229006 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:06:55.229125 (+ 119us) client_negotiation.cc:769] Sending connection context
0620 22:06:55.229221 (+ 96us) client_negotiation.cc:240] Negotiation successful
0620 22:06:55.229353 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":68,"threads_started":1}
I20260620 22:06:55.230103 17628 heartbeater.cc:347] Connected to a master server at 127.1.55.254:40581
I20260620 22:06:55.230191 17628 heartbeater.cc:464] Registering TS with master...
I20260620 22:06:55.230366 17628 heartbeater.cc:511] Master 127.1.55.254:40581 requested a full tablet report, sending...
I20260620 22:06:55.230748 17165 ts_manager.cc:194] Registered new tserver with Master: ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409)
I20260620 22:06:55.231242 17165 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:47803
I20260620 22:06:55.231773 17632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.224824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60432 (local address 127.1.55.254:40581)
0620 22:06:55.224948 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.224950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.225000 (+ 50us) server_negotiation.cc:407] Connection header received
0620 22:06:55.225066 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.225067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.225076 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.225122 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:55.225731 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.226270 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.227261 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.227552 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.227615 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.228757 (+ 1142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:55.228758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:55.228759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:55.228765 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:55.230635 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.230999 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.230999 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.231000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.231046 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.231225 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.231226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.231226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.231309 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:55.231474 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.231634 (+ 160us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.231696 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260620 22:06:55.232558 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:06:55.235009 17632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.232858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60436 (local address 127.1.55.254:40581)
0620 22:06:55.232890 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.232891 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.232979 (+ 88us) server_negotiation.cc:407] Connection header received
0620 22:06:55.233037 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.233037 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.233060 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.233116 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:06:55.233184 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.233677 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.234456 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.234638 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.234682 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.234782 (+ 100us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:06:55.234838 (+ 56us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0620 22:06:55.234974 (+ 136us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60436: token expired
Metrics: {"server-negotiator.queue_time_us":15}
W20260620 22:06:55.235067 17632 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60436: token expired
W20260620 22:06:55.235126 17096 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.55.254:40581)
I20260620 22:06:55.239769 17632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.235316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60438 (local address 127.1.55.254:40581)
0620 22:06:55.235343 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.235344 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.235351 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:06:55.235412 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.235412 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.235418 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.235452 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:06:55.235845 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.236260 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.236851 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.237009 (+ 158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.237071 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.238079 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:06:55.238080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:06:55.238080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:06:55.238085 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:06:55.239077 (+ 992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.239329 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.239329 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.239329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.239368 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:06:55.239502 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:06:55.239502 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:06:55.239503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:06:55.239568 (+ 65us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:06:55.239620 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.239681 (+ 61us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.239727 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260620 22:06:55.240697 17165 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60438:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:06:55.242228 17165 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:06:55.244120 17426 tablet_service.cc:1467] Processing CreateTablet for tablet 2161ed0395a240d69b4a877d32136056 (DEFAULT_TABLE table=test-table [id=d062a48ab1b04d5b8cdbb30586240bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:55.244298 17426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2161ed0395a240d69b4a877d32136056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:55.245734 17384 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: Bootstrap starting.
I20260620 22:06:55.245882 17287 tablet_service.cc:1467] Processing CreateTablet for tablet 2161ed0395a240d69b4a877d32136056 (DEFAULT_TABLE table=test-table [id=d062a48ab1b04d5b8cdbb30586240bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:55.246011 17287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2161ed0395a240d69b4a877d32136056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:55.246037 17384 tablet_bootstrap.cc:654] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:55.246531 17384 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: No bootstrap required, opened a new log
I20260620 22:06:55.246579 17384 ts_tablet_manager.cc:1397] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:55.246889 17384 raft_consensus.cc:348] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.246963 17384 raft_consensus.cc:374] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:55.247009 17384 raft_consensus.cc:729] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f2896c24f440968eb2067356029f34, State: Initialized, Role: FOLLOWER
I20260620 22:06:55.247059 17384 consensus_queue.cc:260] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.247148 17384 ts_tablet_manager.cc:1428] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260620 22:06:55.247324 17245 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Bootstrap starting.
I20260620 22:06:55.247443 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.243890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40409 (local address 127.0.0.1:59156)
0620 22:06:55.243929 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:55.243938 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:55.243971 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:55.244234 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:55.244235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:55.244236 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:55.244271 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.244272 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.245325 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.245326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.246227 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.246230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.247225 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.247226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.247287 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.247290 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:06:55.247337 (+ 47us) client_negotiation.cc:240] Negotiation successful
0620 22:06:55.247377 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260620 22:06:55.247627 17245 tablet_bootstrap.cc:654] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:55.247812 17634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.243939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59156 (local address 127.1.55.195:40409)
0620 22:06:55.244082 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.244086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.244094 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:55.244125 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.244127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.244140 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.244218 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:55.244324 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.245256 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.246311 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.247006 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.247072 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.247122 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.247659 (+ 537us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.247697 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260620 22:06:55.248159 17245 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: No bootstrap required, opened a new log
I20260620 22:06:55.248203 17245 ts_tablet_manager.cc:1397] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260620 22:06:55.248310 17245 raft_consensus.cc:348] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.248376 17245 raft_consensus.cc:374] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:55.248404 17245 raft_consensus.cc:729] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb368779368c45eb9e2171797db4193b, State: Initialized, Role: FOLLOWER
I20260620 22:06:55.248471 17245 consensus_queue.cc:260] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.248415 17562 tablet_service.cc:1467] Processing CreateTablet for tablet 2161ed0395a240d69b4a877d32136056 (DEFAULT_TABLE table=test-table [id=d062a48ab1b04d5b8cdbb30586240bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:06:55.248566 17245 ts_tablet_manager.cc:1428] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260620 22:06:55.248726 17562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2161ed0395a240d69b4a877d32136056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:06:55.251425 17637 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: Bootstrap starting.
I20260620 22:06:55.251899 17637 tablet_bootstrap.cc:654] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: Neither blocks nor log segments found. Creating new log.
I20260620 22:06:55.252317 17637 log.cc:824] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:06:55.253001 17637 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: No bootstrap required, opened a new log
I20260620 22:06:55.253077 17637 ts_tablet_manager.cc:1397] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:06:55.254387 17637 raft_consensus.cc:348] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.254532 17637 raft_consensus.cc:374] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:06:55.254573 17637 raft_consensus.cc:729] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec6e4359c3be4ed3924849b8a204869a, State: Initialized, Role: FOLLOWER
I20260620 22:06:55.254714 17637 consensus_queue.cc:260] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.254824 17639 raft_consensus.cc:482] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:06:55.254904 17639 raft_consensus.cc:504] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.254944 17628 heartbeater.cc:503] Master 127.1.55.254:40581 was elected leader, sending a full tablet report...
I20260620 22:06:55.254956 17637 ts_tablet_manager.cc:1428] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:06:55.255200 17639 leader_election.cc:288] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb368779368c45eb9e2171797db4193b (127.1.55.193:33019), e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
I20260620 22:06:55.258168 17630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.255319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33019 (local address 127.1.55.195:60787)
0620 22:06:55.255350 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:55.255360 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:55.255403 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:55.255627 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:55.255642 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:55.255643 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:55.255691 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.255692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.256418 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.256419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.257250 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.257253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.257981 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.257981 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.258032 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.258034 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:06:55.258076 (+ 42us) client_negotiation.cc:240] Negotiation successful
0620 22:06:55.258099 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260620 22:06:55.258200 17361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.255408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:60787 (local address 127.1.55.193:33019)
0620 22:06:55.255449 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.255451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.255459 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:55.255481 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.255482 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.255492 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.255543 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:55.255787 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.256327 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.257337 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.257903 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.257977 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.257984 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.258103 (+ 119us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.258147 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:06:55.258450 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.255348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41309 (local address 127.1.55.195:46753)
0620 22:06:55.255665 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:55.255672 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0620 22:06:55.255739 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:06:55.255897 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:06:55.255898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:06:55.255900 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:06:55.255953 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.255955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.256603 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.256604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.257361 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:06:55.257363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.258167 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.258168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:06:55.258308 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.258312 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:06:55.258365 (+ 53us) client_negotiation.cc:240] Negotiation successful
0620 22:06:55.258395 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":71,"threads_started":1}
I20260620 22:06:55.258493 17498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.255499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:46753 (local address 127.1.55.194:41309)
0620 22:06:55.255541 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.255542 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.255729 (+ 187us) server_negotiation.cc:407] Connection header received
0620 22:06:55.255805 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.255806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.255822 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.255879 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:06:55.256013 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.256481 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.257438 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.258095 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.258161 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.258220 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.258380 (+ 160us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.258430 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:06:55.258546 17307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2161ed0395a240d69b4a877d32136056" candidate_uuid: "ec6e4359c3be4ed3924849b8a204869a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb368779368c45eb9e2171797db4193b" is_pre_election: true
I20260620 22:06:55.258683 17307 raft_consensus.cc:2454] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec6e4359c3be4ed3924849b8a204869a in term 0.
I20260620 22:06:55.258715 17446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2161ed0395a240d69b4a877d32136056" candidate_uuid: "ec6e4359c3be4ed3924849b8a204869a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f2896c24f440968eb2067356029f34" is_pre_election: true
I20260620 22:06:55.258826 17446 raft_consensus.cc:2454] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec6e4359c3be4ed3924849b8a204869a in term 0.
I20260620 22:06:55.258911 17518 leader_election.cc:302] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec6e4359c3be4ed3924849b8a204869a, fb368779368c45eb9e2171797db4193b; no voters:
I20260620 22:06:55.259016 17639 raft_consensus.cc:2781] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:06:55.259093 17639 raft_consensus.cc:482] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:06:55.259130 17639 raft_consensus.cc:3037] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:55.259661 17639 raft_consensus.cc:504] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.259799 17639 leader_election.cc:288] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [CANDIDATE]: Term 1 election: Requested vote from peers fb368779368c45eb9e2171797db4193b (127.1.55.193:33019), e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
I20260620 22:06:55.259953 17307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2161ed0395a240d69b4a877d32136056" candidate_uuid: "ec6e4359c3be4ed3924849b8a204869a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb368779368c45eb9e2171797db4193b"
I20260620 22:06:55.260033 17307 raft_consensus.cc:3037] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:55.260003 17446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2161ed0395a240d69b4a877d32136056" candidate_uuid: "ec6e4359c3be4ed3924849b8a204869a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f2896c24f440968eb2067356029f34"
I20260620 22:06:55.260093 17446 raft_consensus.cc:3037] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:06:55.260811 17446 raft_consensus.cc:2454] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6e4359c3be4ed3924849b8a204869a in term 1.
I20260620 22:06:55.260972 17516 leader_election.cc:302] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3f2896c24f440968eb2067356029f34, ec6e4359c3be4ed3924849b8a204869a; no voters:
I20260620 22:06:55.261049 17307 raft_consensus.cc:2454] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec6e4359c3be4ed3924849b8a204869a in term 1.
I20260620 22:06:55.261072 17639 raft_consensus.cc:2781] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:06:55.261116 17639 raft_consensus.cc:686] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 1 LEADER]: Becoming Leader. State: Replica: ec6e4359c3be4ed3924849b8a204869a, State: Running, Role: LEADER
I20260620 22:06:55.261201 17639 consensus_queue.cc:237] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:06:55.261927 17164 catalog_manager.cc:5495] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a reported cstate change: term changed from 0 to 1, leader changed from <none> to ec6e4359c3be4ed3924849b8a204869a (127.1.55.195). New cstate: current_term: 1 leader_uuid: "ec6e4359c3be4ed3924849b8a204869a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } health_report { overall_health: UNKNOWN } } }
I20260620 22:06:55.269814 17634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.267580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.1.55.195:40409)
0620 22:06:55.267633 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:06:55.267634 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:06:55.267642 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:06:55.267699 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:06:55.267700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:06:55.267714 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:06:55.267818 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:06:55.267930 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.268366 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.269042 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:06:55.269239 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:06:55.269319 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:06:55.269524 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:06:55.269608 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:06:55.269694 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 22:06:55.269715 (+ 21us) server_negotiation.cc:299] Negotiation successful
0620 22:06:55.269731 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:06:55.271261 17307 raft_consensus.cc:1261] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Refusing update from remote peer ec6e4359c3be4ed3924849b8a204869a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:55.271268 17446 raft_consensus.cc:1261] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Refusing update from remote peer ec6e4359c3be4ed3924849b8a204869a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:06:55.271579 17640 consensus_queue.cc:1035] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:55.271687 17639 consensus_queue.cc:1035] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:06:55.273942 17646 mvcc.cc:205] Tried to move back new op lower bound from 7299044209749123072 to 7299044209710624768. Current Snapshot: MvccSnapshot[applied={T|T < 7299044209749123072 or (T in {7299044209749123072})}]
I20260620 22:06:55.275590 17165 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:55.275681 17165 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:06:55.276232 17165 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Sending DeleteTablet for 3 replicas of tablet 2161ed0395a240d69b4a877d32136056
I20260620 22:06:55.276475 17562 tablet_service.cc:1514] Processing DeleteTablet for tablet 2161ed0395a240d69b4a877d32136056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:55 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:59156
I20260620 22:06:55.276566 17426 tablet_service.cc:1514] Processing DeleteTablet for tablet 2161ed0395a240d69b4a877d32136056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:55 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:60754
I20260620 22:06:55.276647 17287 tablet_service.cc:1514] Processing DeleteTablet for tablet 2161ed0395a240d69b4a877d32136056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:06:55 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:40520
I20260620 22:06:55.276651 17499 tablet_replica.cc:330] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: stopping tablet replica
I20260620 22:06:55.276708 17499 raft_consensus.cc:2229] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:55.276719 17362 tablet_replica.cc:330] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: stopping tablet replica
I20260620 22:06:55.276767 17362 raft_consensus.cc:2229] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:06:55.276774 17499 raft_consensus.cc:2258] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:55.276816 17362 raft_consensus.cc:2258] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:55.276834 17653 tablet_replica.cc:330] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: stopping tablet replica
I20260620 22:06:55.276906 17653 raft_consensus.cc:2229] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:06:55.276916 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 17203
I20260620 22:06:55.276994 17653 raft_consensus.cc:2258] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:06:55.277084 17499 ts_tablet_manager.cc:1905] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:55.278337 17499 ts_tablet_manager.cc:1918] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:55.278388 17499 log.cc:1196] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/2161ed0395a240d69b4a877d32136056
I20260620 22:06:55.278620 17499 ts_tablet_manager.cc:1939] T 2161ed0395a240d69b4a877d32136056 P e3f2896c24f440968eb2067356029f34: Deleting consensus metadata
I20260620 22:06:55.278925 17150 catalog_manager.cc:4841] TS e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309): tablet 2161ed0395a240d69b4a877d32136056 (table test-table [id=d062a48ab1b04d5b8cdbb30586240bb0]) successfully deleted
I20260620 22:06:55.279500 17653 ts_tablet_manager.cc:1905] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:06:55.281190 17653 ts_tablet_manager.cc:1918] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:06:55.281260 17653 log.cc:1196] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/2161ed0395a240d69b4a877d32136056
I20260620 22:06:55.281540 17653 ts_tablet_manager.cc:1939] T 2161ed0395a240d69b4a877d32136056 P ec6e4359c3be4ed3924849b8a204869a: Deleting consensus metadata
I20260620 22:06:55.281886 17149 catalog_manager.cc:4841] TS ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409): tablet 2161ed0395a240d69b4a877d32136056 (table test-table [id=d062a48ab1b04d5b8cdbb30586240bb0]) successfully deleted
W20260620 22:06:55.283914 17152 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:33019 (error 108)
I20260620 22:06:55.285087 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 17357
I20260620 22:06:55.285909 17360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:06:55.285795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33019 (local address 127.0.0.1:40534)
0620 22:06:55.285846 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0620 22:06:55.285881 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260620 22:06:55.285998 17152 catalog_manager.cc:4584] TS fb368779368c45eb9e2171797db4193b (127.1.55.193:33019): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2161ed0395a240d69b4a877d32136056: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33019: connect: Connection refused (error 111)
I20260620 22:06:55.290145 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 17496
I20260620 22:06:55.295176 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 17132
I20260620 22:07:15.300328 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40581
--webserver_interface=127.1.55.254
--webserver_port=42227
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:40581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:15.376904 17655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:15.377068 17655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:15.377086 17655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:15.378060 17655 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260620 22:07:15.378094 17655 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260620 22:07:15.378105 17655 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260620 22:07:15.378115 17655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:15.378126 17655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:15.378140 17655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:15.378150 17655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:15.378166 17655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:15.379432 17655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:40581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:40581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=42227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:15.379604 17655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:15.379742 17655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:15.384326 17661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:15.384371 17655 server_base.cc:1034] running on GCE node
W20260620 22:07:15.384414 17660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:15.384330 17663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:15.384800 17655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:15.385061 17655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:15.386188 17655 hybrid_clock.cc:648] HybridClock initialized: now 1781993235386175 us; error 29 us; skew 500 ppm
Jun 20 22:07:15 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993235, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:15.388283 17655 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:15.388682 17655 webserver.cc:460] Webserver started at http://127.1.55.254:42227/ using document root <none> and password file <none>
I20260620 22:07:15.388854 17655 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:15.388892 17655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:15.390082 17655 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260620 22:07:15.390619 17670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.390774 17655 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:15.390842 17655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "4c0fd647ee33400ba6ab844d7cf6c50a"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "fcc591d4b9d71075f55d5712c37a665d"
server_key_iv: "b27f0c417f4c453e2e44f279577ec089"
server_key_version: "encryptionkey@0"
I20260620 22:07:15.391112 17655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:15.406368 17655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:15.407925 17655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:15.408063 17655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:15.411597 17655 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:40581
I20260620 22:07:15.411640 17722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:40581 every 8 connection(s)
I20260620 22:07:15.411911 17655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:15.413062 17723 sys_catalog.cc:263] Verifying existing consensus state
I20260620 22:07:15.413681 17723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Bootstrap starting.
I20260620 22:07:15.414772 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 17655
I20260620 22:07:15.415038 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:33019
--local_ip_for_outbound_sockets=127.1.55.193
--tserver_master_addrs=127.1.55.254:40581
--webserver_port=46441
--webserver_interface=127.1.55.193
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:07:15.421715 17723 log.cc:824] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:15.423454 17723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:07:15.423698 17723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: Bootstrap complete.
I20260620 22:07:15.425769 17723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:07:15.425956 17723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c0fd647ee33400ba6ab844d7cf6c50a, State: Initialized, Role: FOLLOWER
I20260620 22:07:15.426095 17723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:07:15.426141 17723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:15.426193 17723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:15.426236 17723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 2 FOLLOWER]: Advancing to term 3
I20260620 22:07:15.427052 17723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:07:15.427145 17723 leader_election.cc:302] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c0fd647ee33400ba6ab844d7cf6c50a; no voters:
I20260620 22:07:15.427295 17723 leader_election.cc:288] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260620 22:07:15.427328 17727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 3 FOLLOWER]: Leader election won for term 3
I20260620 22:07:15.427474 17727 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [term 3 LEADER]: Becoming Leader. State: Replica: 4c0fd647ee33400ba6ab844d7cf6c50a, State: Running, Role: LEADER
I20260620 22:07:15.427510 17723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:15.427599 17727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } }
I20260620 22:07:15.427862 17727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c0fd647ee33400ba6ab844d7cf6c50a. Latest consensus state: current_term: 3 leader_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } } }
I20260620 22:07:15.427954 17727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:15.427865 17728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c0fd647ee33400ba6ab844d7cf6c50a" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 40581 } } }
I20260620 22:07:15.428117 17728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:15.429183 17743 catalog_manager.cc:1259] Loaded cluster ID: 9da7c4ded5854180b08f7b95bb49be31
I20260620 22:07:15.429226 17743 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: loading cluster ID for follower catalog manager: success
I20260620 22:07:15.430260 17743 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4c0fd647ee33400ba6ab844d7cf6c50a: acquiring CA information for follower catalog manager: success
F20260620 22:07:15.430601 17743 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f70dcbce9ad google::LogMessage::Fail() at ??:0
@ 0x7f70dcbd188a google::LogMessage::SendToLog() at ??:0
@ 0x7f70dcbce4de google::LogMessage::Flush() at ??:0
@ 0x7f70dcbcfa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f70df33b104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f70e4b2b6b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f70e4b2b989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f70e4b2be4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f70e4b2e8c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f70dea91954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f70df8f56db start_thread at ??:0
@ 0x7f70db6cc61f clone at ??:0
W20260620 22:07:15.500908 17725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:15.501086 17725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:15.501119 17725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:15.502163 17725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:15.502220 17725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:15.502266 17725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:07:15.503518 17725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:33019
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=46441
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:15.503734 17725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:15.503923 17725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:15.508359 17762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:15.508383 17764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:15.508330 17761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:15.508561 17725 server_base.cc:1034] running on GCE node
I20260620 22:07:15.508721 17725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:15.508924 17725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:15.510056 17725 hybrid_clock.cc:648] HybridClock initialized: now 1781993235510046 us; error 38 us; skew 500 ppm
Jun 20 22:07:15 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993235, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:15.512507 17725 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:07:15.512924 17725 webserver.cc:460] Webserver started at http://127.1.55.193:46441/ using document root <none> and password file <none>
I20260620 22:07:15.513126 17725 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:15.513190 17725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:15.514521 17725 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:15.515187 17771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.515406 17725 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:15.515492 17725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "fb368779368c45eb9e2171797db4193b"
format_stamp: "Formatted at 2026-06-20 22:06:33 on dist-test-slave-xw35"
server_key: "71b7c0a3557d605aca4535a969ded0e2"
server_key_iv: "8703c0274aecc3628b112294ddf67af9"
server_key_version: "encryptionkey@0"
I20260620 22:07:15.515762 17725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:15.534984 17725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:15.536751 17725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:15.536887 17725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:15.537067 17725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:15.537407 17778 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 22:07:15.538970 17725 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 22:07:15.539032 17725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260620 22:07:15.539067 17725 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 22:07:15.539604 17725 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 22:07:15.539677 17725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:15.539723 17778 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Bootstrap starting.
I20260620 22:07:15.546221 17725 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:33019
I20260620 22:07:15.546278 17885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:33019 every 8 connection(s)
I20260620 22:07:15.546571 17725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:07:15.549837 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 17725
I20260620 22:07:15.549952 17778 log.cc:824] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:15.550132 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:41309
--local_ip_for_outbound_sockets=127.1.55.194
--tserver_master_addrs=127.1.55.254:40581
--webserver_port=37387
--webserver_interface=127.1.55.194
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:07:15.552362 17778 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 22:07:15.552676 17778 tablet_bootstrap.cc:492] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Bootstrap complete.
I20260620 22:07:15.553854 17778 ts_tablet_manager.cc:1397] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260620 22:07:15.555136 17778 raft_consensus.cc:348] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:07:15.555462 17778 raft_consensus.cc:729] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb368779368c45eb9e2171797db4193b, State: Initialized, Role: FOLLOWER
I20260620 22:07:15.555619 17778 consensus_queue.cc:260] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:07:15.555830 17778 ts_tablet_manager.cc:1428] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260620 22:07:15.600994 17888 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:07:15.547116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:51989)
0620 22:07:15.547267 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.547301 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:15.547711 (+ 410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:15.600860 (+ 53149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":80,"threads_started":1}
W20260620 22:07:15.601177 17886 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:40581 (0 consecutive failures): Network error: Failed to ping master at 127.1.55.254:40581: Client connection negotiation failed: client connection to 127.1.55.254:40581: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 22:07:15.601464 17888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:15.601361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:55439)
0620 22:07:15.601409 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.601448 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260620 22:07:15.601817 17888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:15.601736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:49997)
0620 22:07:15.601778 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.601799 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260620 22:07:15.601933 17886 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 22:07:15.631640 17890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:15.631819 17890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:15.631851 17890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:15.632844 17890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:15.632897 17890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:15.632936 17890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:07:15.634461 17890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:41309
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=37387
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:15.634687 17890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:15.634898 17890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:15.639221 17899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:15.639225 17896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:15.639302 17897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:15.639474 17890 server_base.cc:1034] running on GCE node
I20260620 22:07:15.639678 17890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:15.639891 17890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:15.641021 17890 hybrid_clock.cc:648] HybridClock initialized: now 1781993235641007 us; error 28 us; skew 500 ppm
Jun 20 22:07:15 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993235, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:15.643059 17890 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:07:15.643438 17890 webserver.cc:460] Webserver started at http://127.1.55.194:37387/ using document root <none> and password file <none>
I20260620 22:07:15.643617 17890 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:15.643672 17890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:15.644850 17890 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:15.645344 17906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.645783 17890 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:15.645877 17890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "e3f2896c24f440968eb2067356029f34"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "01fad412f60e9763cf1e6b7de30ed112"
server_key_iv: "1659a6209bd5c867745fdf18a8b8ee6a"
server_key_version: "encryptionkey@0"
I20260620 22:07:15.646153 17890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:15.654661 17890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:15.656232 17890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:15.656363 17890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:15.656575 17890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:15.656813 17890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:15.656863 17890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.656898 17890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:15.656924 17890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.661976 17890 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:41309
I20260620 22:07:15.662026 18019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:41309 every 8 connection(s)
I20260620 22:07:15.662290 17890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:07:15.663105 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:15.662807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:44455)
0620 22:07:15.662950 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.663000 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
W20260620 22:07:15.663411 18020 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:40581 (0 consecutive failures): Network error: Failed to ping master at 127.1.55.254:40581: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
I20260620 22:07:15.663632 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:15.663560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:46791)
0620 22:07:15.663598 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.663619 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260620 22:07:15.663826 18022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:15.663786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:43301)
0620 22:07:15.663803 (+ 17us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.663817 (+ 14us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9}
W20260620 22:07:15.663906 18020 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 22:07:15.664496 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 17890
I20260620 22:07:15.664745 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:40409
--local_ip_for_outbound_sockets=127.1.55.195
--tserver_master_addrs=127.1.55.254:40581
--webserver_port=46325
--webserver_interface=127.1.55.195
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:46381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:15.736157 18023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:15.736316 18023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:15.736336 18023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:15.737309 18023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:15.737344 18023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:15.737383 18023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:07:15.738652 18023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:46381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:40409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=46325
--tserver_master_addrs=127.1.55.254:40581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:15.738890 18023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:15.739102 18023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:15.743347 18029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:15.743438 18023 server_base.cc:1034] running on GCE node
W20260620 22:07:15.743460 18031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:15.743604 18028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:15.743800 18023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:15.743973 18023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:15.745105 18023 hybrid_clock.cc:648] HybridClock initialized: now 1781993235745094 us; error 25 us; skew 500 ppm
Jun 20 22:07:15 dist-test-slave-xw35 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993235, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:15.747364 18023 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:07:15.747733 18023 webserver.cc:460] Webserver started at http://127.1.55.195:46325/ using document root <none> and password file <none>
I20260620 22:07:15.747989 18023 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:15.748080 18023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:15.749342 18023 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:07:15.749918 18038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.750061 18023 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.750147 18023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "ec6e4359c3be4ed3924849b8a204869a"
format_stamp: "Formatted at 2026-06-20 22:06:34 on dist-test-slave-xw35"
server_key: "a340aaad759ecf60f409ddd46abcf993"
server_key_iv: "6bff3fcb7bbf1be2414b888b35939eab"
server_key_version: "encryptionkey@0"
I20260620 22:07:15.750413 18023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:15.764825 18023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:15.766498 18023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:15.766646 18023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:15.766844 18023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:15.767096 18023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:15.767153 18023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.767185 18023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:15.767208 18023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:15.772532 18023 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:40409
I20260620 22:07:15.772564 18151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:40409 every 8 connection(s)
I20260620 22:07:15.772858 18023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:07:15.773785 18154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:15.773446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:36665)
0620 22:07:15.773619 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.773674 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":107,"threads_started":1}
W20260620 22:07:15.774108 18152 heartbeater.cc:644] Failed to heartbeat to 127.1.55.254:40581 (0 consecutive failures): Network error: Failed to ping master at 127.1.55.254:40581: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
I20260620 22:07:15.774402 18154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:15.774303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:51609)
0620 22:07:15.774355 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.774386 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260620 22:07:15.774657 18154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:15.774576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:33261)
0620 22:07:15.774618 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:15.774640 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260620 22:07:15.774763 18152 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 22:07:15.778991 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 18023
I20260620 22:07:16.602667 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:16.602483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:52979)
0620 22:07:16.602591 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:16.602617 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260620 22:07:16.664345 18157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:16.664176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:46551)
0620 22:07:16.664274 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:16.664304 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":52,"threads_started":1}
I20260620 22:07:16.775208 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:16.775036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:37959)
0620 22:07:16.775134 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:16.775165 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":49,"threads_started":1}
I20260620 22:07:17.381158 18159 raft_consensus.cc:482] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:17.381270 18159 raft_consensus.cc:504] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:07:17.381642 18159 leader_election.cc:288] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409), e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
Jun 20 22:07:17 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993235, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.194@KRBTEST.COM
Jun 20 22:07:17 dist-test-slave-xw35 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993235, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.195@KRBTEST.COM
I20260620 22:07:17.391232 18160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:17.381762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:40409 (local address 127.1.55.193:60351)
0620 22:07:17.381866 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:17.381876 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:17.381935 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:17.382667 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:17.382670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:17.383030 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:17.383206 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:17.383211 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:17.384279 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:17.384280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:17.385049 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:17.385052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:17.385712 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:17.385713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:17.385805 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:17.386379 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:17.386383 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:17.388055 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:17.389879 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:17.389880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:17.389880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:17.390123 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:17.390411 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:17.390412 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:17.390412 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:17.390473 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:17.390848 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:17.390848 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:17.390881 (+ 33us) client_negotiation.cc:769] Sending connection context
0620 22:07:17.390962 (+ 81us) client_negotiation.cc:240] Negotiation successful
0620 22:07:17.391140 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":71,"thread_start_us":50,"threads_started":1}
I20260620 22:07:17.391247 18163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:17.381920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:58283 (local address 127.1.55.194:41309)
0620 22:07:17.382059 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:17.382072 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:17.382088 (+ 16us) server_negotiation.cc:407] Connection header received
0620 22:07:17.382462 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:17.382464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:17.382500 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:17.382636 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:17.383320 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:17.384178 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:17.385145 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:17.385603 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:17.385720 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:17.387752 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:17.387763 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:17.387764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:17.387772 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:17.389623 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:17.390062 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:17.390065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:17.390065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:17.390170 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:17.390417 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:17.390418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:17.390418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:17.390661 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:17.390730 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:17.391054 (+ 324us) server_negotiation.cc:299] Negotiation successful
0620 22:07:17.391159 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":36,"threads_started":1}
I20260620 22:07:17.391266 18162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:17.381885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:60351 (local address 127.1.55.195:40409)
0620 22:07:17.382037 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:17.382048 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:17.382067 (+ 19us) server_negotiation.cc:407] Connection header received
0620 22:07:17.382462 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:17.382464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:17.382500 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:17.382641 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:17.383346 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:17.384191 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:17.385152 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:17.385607 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:17.385733 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:17.388159 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:17.388162 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:17.388162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:17.388172 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:17.389801 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:17.390198 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:17.390217 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:17.390217 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:17.390319 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:17.390537 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:17.390538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:17.390538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:17.390779 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:17.390852 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:17.391030 (+ 178us) server_negotiation.cc:299] Negotiation successful
0620 22:07:17.391165 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":46,"threads_started":1}
I20260620 22:07:17.391331 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:17.381799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:41309 (local address 127.1.55.193:58283)
0620 22:07:17.381941 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:17.381948 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:17.381983 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:17.382667 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:17.382670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:17.383029 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:17.383206 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:17.383211 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:17.384271 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:17.384272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:17.385047 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:17.385049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:17.385706 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:17.385706 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:17.385809 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:17.386316 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:17.386323 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:17.387663 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:17.389694 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:17.389701 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:17.389703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:17.389992 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:17.390236 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:17.390236 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:17.390237 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:17.390346 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:17.390739 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:17.390744 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:17.390879 (+ 135us) client_negotiation.cc:769] Sending connection context
0620 22:07:17.390988 (+ 109us) client_negotiation.cc:240] Negotiation successful
0620 22:07:17.391211 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":128,"thread_start_us":84,"threads_started":1}
W20260620 22:07:17.392419 17773 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
W20260620 22:07:17.392495 17772 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
I20260620 22:07:17.392521 17773 leader_election.cc:302] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb368779368c45eb9e2171797db4193b; no voters: e3f2896c24f440968eb2067356029f34, ec6e4359c3be4ed3924849b8a204869a
I20260620 22:07:17.392642 18159 raft_consensus.cc:2726] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:07:17.603222 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:17.603114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:60205)
0620 22:07:17.603158 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:17.603188 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260620 22:07:17.664893 18164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:17.664708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:42055)
0620 22:07:17.664818 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:17.664856 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260620 22:07:17.775804 18165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:17.775560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:47375)
0620 22:07:17.775714 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:17.775753 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260620 22:07:18.603950 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:18.603717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:59877)
0620 22:07:18.603870 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:18.603905 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260620 22:07:18.665536 18167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:18.665292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:38387)
0620 22:07:18.665420 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:18.665452 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260620 22:07:18.776393 18168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:18.776205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:38025)
0620 22:07:18.776328 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:18.776364 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
I20260620 22:07:19.538599 18169 raft_consensus.cc:482] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:19.538679 18169 raft_consensus.cc:504] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:07:19.538866 18169 leader_election.cc:288] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409), e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
W20260620 22:07:19.539271 17773 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
W20260620 22:07:19.539337 17772 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
I20260620 22:07:19.539366 17772 leader_election.cc:302] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb368779368c45eb9e2171797db4193b; no voters: e3f2896c24f440968eb2067356029f34, ec6e4359c3be4ed3924849b8a204869a
I20260620 22:07:19.539450 18169 raft_consensus.cc:2726] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:07:19.604679 18170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:19.604459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:53749)
0620 22:07:19.604579 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:19.604632 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260620 22:07:19.666119 18171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:19.665940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:44481)
0620 22:07:19.666045 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:19.666076 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":49,"threads_started":1}
I20260620 22:07:19.776929 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:19.776732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:58703)
0620 22:07:19.776852 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:19.776881 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":61,"threads_started":1}
I20260620 22:07:20.605329 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:20.605093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:52387)
0620 22:07:20.605249 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:20.605283 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":58,"threads_started":1}
I20260620 22:07:20.666656 18174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:20.666498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:37283)
0620 22:07:20.666597 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:20.666624 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":51,"threads_started":1}
I20260620 22:07:20.777563 18175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:20.777332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:56253)
0620 22:07:20.777465 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:20.777530 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":53,"threads_started":1}
I20260620 22:07:21.605964 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:21.605759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:49217)
0620 22:07:21.605881 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:21.605916 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":56,"threads_started":1}
I20260620 22:07:21.667196 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:21.667032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:35153)
0620 22:07:21.667136 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:21.667161 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":54,"threads_started":1}
I20260620 22:07:21.778141 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:21.777937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:43239)
0620 22:07:21.778077 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:21.778110 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
I20260620 22:07:22.157873 18179 raft_consensus.cc:482] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:22.157985 18179 raft_consensus.cc:504] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:07:22.158177 18179 leader_election.cc:288] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409), e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
W20260620 22:07:22.158594 17772 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
W20260620 22:07:22.158675 17773 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
I20260620 22:07:22.158737 17773 leader_election.cc:302] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb368779368c45eb9e2171797db4193b; no voters: e3f2896c24f440968eb2067356029f34, ec6e4359c3be4ed3924849b8a204869a
I20260620 22:07:22.158830 18179 raft_consensus.cc:2726] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:07:22.606594 18180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:22.606399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:51767)
0620 22:07:22.606519 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:22.606551 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":71,"threads_started":1}
I20260620 22:07:22.667713 18181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:22.667557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:38251)
0620 22:07:22.667654 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:22.667681 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":51,"threads_started":1}
I20260620 22:07:22.778705 18182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:22.778542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:55443)
0620 22:07:22.778643 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:22.778672 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":50,"threads_started":1}
I20260620 22:07:23.607417 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:23.607169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:39029)
0620 22:07:23.607297 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:23.607339 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":54,"threads_started":1}
I20260620 22:07:23.668366 18184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:23.668182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:46429)
0620 22:07:23.668299 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:23.668331 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":57,"threads_started":1}
I20260620 22:07:23.779474 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:23.779282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:46781)
0620 22:07:23.779408 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:23.779440 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260620 22:07:24.237073 18186 raft_consensus.cc:482] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:24.237172 18186 raft_consensus.cc:504] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:07:24.237344 18186 leader_election.cc:288] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409), e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
W20260620 22:07:24.237660 17772 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
W20260620 22:07:24.237735 17773 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
I20260620 22:07:24.237813 17773 leader_election.cc:302] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb368779368c45eb9e2171797db4193b; no voters: e3f2896c24f440968eb2067356029f34, ec6e4359c3be4ed3924849b8a204869a
I20260620 22:07:24.237897 18186 raft_consensus.cc:2726] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:07:24.608040 18187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:24.607845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:47123)
0620 22:07:24.607961 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:24.607995 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
I20260620 22:07:24.669003 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:24.668800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:44341)
0620 22:07:24.668908 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:24.668937 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":58,"threads_started":1}
I20260620 22:07:24.780037 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:24.779848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:40891)
0620 22:07:24.779967 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:24.780000 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":53,"threads_started":1}
I20260620 22:07:25.608639 18190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:25.608438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:36669)
0620 22:07:25.608558 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:25.608592 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260620 22:07:25.669575 18191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:25.669369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:47323)
0620 22:07:25.669513 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:25.669540 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
I20260620 22:07:25.780602 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:25.780423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:35561)
0620 22:07:25.780543 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:25.780568 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":59,"threads_started":1}
I20260620 22:07:26.609227 18193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:26.609037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:55149)
0620 22:07:26.609141 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:26.609184 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":54,"threads_started":1}
I20260620 22:07:26.670207 18194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:26.669992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:49527)
0620 22:07:26.670132 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:26.670172 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":54,"threads_started":1}
I20260620 22:07:26.781279 18195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:26.781093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:55199)
0620 22:07:26.781216 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:26.781247 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260620 22:07:27.609895 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:27.609698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:35421)
0620 22:07:27.609816 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:27.609848 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":58,"threads_started":1}
I20260620 22:07:27.670840 18197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:27.670564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:35861)
0620 22:07:27.670767 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:27.670800 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":59,"threads_started":1}
I20260620 22:07:27.781869 18198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:27.781653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:51621)
0620 22:07:27.781808 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:27.781834 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
I20260620 22:07:28.610505 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:28.610292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:45011)
0620 22:07:28.610426 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:28.610459 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":59,"threads_started":1}
I20260620 22:07:28.671458 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:28.671273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:33589)
0620 22:07:28.671394 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:28.671423 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260620 22:07:28.782382 18201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:28.782199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:59063)
0620 22:07:28.782324 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:28.782350 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260620 22:07:29.611248 18202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:29.611036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:52249)
0620 22:07:29.611157 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:29.611189 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":82,"threads_started":1}
I20260620 22:07:29.672065 18203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:29.671885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:34505)
0620 22:07:29.671998 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:29.672028 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260620 22:07:29.706060 18204 raft_consensus.cc:482] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:29.706190 18204 raft_consensus.cc:504] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec6e4359c3be4ed3924849b8a204869a" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 40409 } } peers { permanent_uuid: "fb368779368c45eb9e2171797db4193b" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33019 } } peers { permanent_uuid: "e3f2896c24f440968eb2067356029f34" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 41309 } }
I20260620 22:07:29.706427 18204 leader_election.cc:288] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409), e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309)
W20260620 22:07:29.706781 17772 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ec6e4359c3be4ed3924849b8a204869a (127.1.55.195:40409): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
W20260620 22:07:29.706856 17773 leader_election.cc:341] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e3f2896c24f440968eb2067356029f34 (127.1.55.194:41309): Not found: Tablet not found: 2161ed0395a240d69b4a877d32136056
I20260620 22:07:29.706912 17773 leader_election.cc:302] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb368779368c45eb9e2171797db4193b; no voters: e3f2896c24f440968eb2067356029f34, ec6e4359c3be4ed3924849b8a204869a
I20260620 22:07:29.706991 18204 raft_consensus.cc:2726] T 2161ed0395a240d69b4a877d32136056 P fb368779368c45eb9e2171797db4193b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 22:07:29.783003 18205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:29.782792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:56365)
0620 22:07:29.782933 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:29.782963 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":70,"threads_started":1}
I20260620 22:07:30.611924 18206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:30.611737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.193:46495)
0620 22:07:30.611850 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:30.611881 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":55,"threads_started":1}
I20260620 22:07:30.672710 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:30.672507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.194:49801)
0620 22:07:30.672622 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:30.672654 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
I20260620 22:07:30.783722 18208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:30.783552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:40581 (local address 127.1.55.195:38125)
0620 22:07:30.783662 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:30.783691 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.254:40581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260620 22:07:30.787184 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 17725
I20260620 22:07:30.791805 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 17890
I20260620 22:07:30.795897 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 18023
2026-06-20T22:07:30Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58299 ms)
[----------] 30 tests from SecurityITest (248824 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:30 dist-test-slave-xw35 krb5kdc[18211](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:30 dist-test-slave-xw35 krb5kdc[18211](info): set up 2 sockets
Jun 20 22:07:30 dist-test-slave-xw35 krb5kdc[18211](info): commencing operation
krb5kdc: starting...
W20260620 22:07:31.813269 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.998s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:31 dist-test-slave-xw35 krb5kdc[18211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:07:31.920360 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38413
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38413
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:31.997077 18224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:31.997318 18224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:31.997355 18224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:31.998515 18224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:31.998584 18224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:31.998608 18224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:31.998629 18224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:31.998659 18224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:32.000119 18224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38413
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:32.000403 18224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:32.000612 18224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:32.005155 18229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.005157 18232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.005134 18230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:32.005437 18224 server_base.cc:1034] running on GCE node
I20260620 22:07:32.005733 18224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:32.006006 18224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:32.007166 18224 hybrid_clock.cc:648] HybridClock initialized: now 1781993252007158 us; error 39 us; skew 500 ppm
Jun 20 22:07:32 dist-test-slave-xw35 krb5kdc[18211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:32.009563 18224 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:32.010003 18224 webserver.cc:460] Webserver started at http://127.1.55.254:35885/ using document root <none> and password file <none>
I20260620 22:07:32.010172 18224 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:32.010210 18224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:32.010294 18224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:32.011188 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "8ad7138dbfd647b586ddfc6bfd08a09b"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "f9f96911c5a3c72afc09ee0eacdbe84e"
server_key_iv: "c76801049af1bec570e6ad836d30fdd9"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.011466 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "8ad7138dbfd647b586ddfc6bfd08a09b"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "f9f96911c5a3c72afc09ee0eacdbe84e"
server_key_iv: "c76801049af1bec570e6ad836d30fdd9"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.012606 18224 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:32.013236 18239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.013384 18224 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:32.013463 18224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "8ad7138dbfd647b586ddfc6bfd08a09b"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "f9f96911c5a3c72afc09ee0eacdbe84e"
server_key_iv: "c76801049af1bec570e6ad836d30fdd9"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.013564 18224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:32.038234 18224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:32.040380 18224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:32.040486 18224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:32.044263 18224 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:38413
I20260620 22:07:32.044337 18291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:38413 every 8 connection(s)
I20260620 22:07:32.044691 18224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:32.045605 18292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:32.047786 18292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b: Bootstrap starting.
I20260620 22:07:32.048341 18292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:32.048794 18292 log.cc:824] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:32.049597 18292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b: No bootstrap required, opened a new log
I20260620 22:07:32.051168 18292 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad7138dbfd647b586ddfc6bfd08a09b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38413 } }
I20260620 22:07:32.051329 18292 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:32.051376 18292 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ad7138dbfd647b586ddfc6bfd08a09b, State: Initialized, Role: FOLLOWER
I20260620 22:07:32.051539 18292 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad7138dbfd647b586ddfc6bfd08a09b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38413 } }
I20260620 22:07:32.051631 18292 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:32.051671 18292 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:32.051719 18292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:32.052274 18292 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad7138dbfd647b586ddfc6bfd08a09b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38413 } }
I20260620 22:07:32.052392 18292 leader_election.cc:302] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ad7138dbfd647b586ddfc6bfd08a09b; no voters:
I20260620 22:07:32.052577 18292 leader_election.cc:288] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:32.052616 18295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:32.052786 18295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [term 1 LEADER]: Becoming Leader. State: Replica: 8ad7138dbfd647b586ddfc6bfd08a09b, State: Running, Role: LEADER
I20260620 22:07:32.052834 18292 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:32.052889 18295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad7138dbfd647b586ddfc6bfd08a09b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38413 } }
I20260620 22:07:32.053289 18297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ad7138dbfd647b586ddfc6bfd08a09b. Latest consensus state: current_term: 1 leader_uuid: "8ad7138dbfd647b586ddfc6bfd08a09b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad7138dbfd647b586ddfc6bfd08a09b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38413 } } }
I20260620 22:07:32.053392 18296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ad7138dbfd647b586ddfc6bfd08a09b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ad7138dbfd647b586ddfc6bfd08a09b" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38413 } } }
I20260620 22:07:32.053553 18296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:32.053742 18297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:32.053903 18304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:32.054217 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 18224
I20260620 22:07:32.054339 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:32.054457 18304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:32.054533 1247 external_mini_cluster.cc:1428] Setting key d3d3433bef89ed00d623c42486f1c264
I20260620 22:07:32.056197 18304 catalog_manager.cc:1347] Generated new cluster ID: ef67b56d040c47f9b415f99c25066fb3
I20260620 22:07:32.056253 18304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:07:32 dist-test-slave-xw35 krb5kdc[18211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:32.064455 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.055125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37538 (local address 127.1.55.254:38413)
0620 22:07:32.055313 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.055322 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.055353 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:07:32.055456 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.055463 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.055512 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.055671 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:32.056503 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.057384 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.058227 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.058656 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.058790 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.061029 (+ 2239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:32.061033 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:32.061033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:32.061044 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:32.062992 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.063357 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.063360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.063360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.063465 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.063684 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.063685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.063686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.063915 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:32.064080 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.064150 (+ 70us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.064281 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
I20260620 22:07:32.072373 18304 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:32.073086 18304 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:32.085502 18304 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b: Generated new TSK 0
I20260620 22:07:32.085667 18304 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:07:32.116890 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38413
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:32.194146 18318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:32.194365 18318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:32.194402 18318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:32.195544 18318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:32.195611 18318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:32.195653 18318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:07:32.197036 18318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:32.197284 18318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:32.197520 18318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:32.202013 18326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.202031 18324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.202179 18323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:32.202200 18318 server_base.cc:1034] running on GCE node
I20260620 22:07:32.202445 18318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:32.202646 18318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:32.203781 18318 hybrid_clock.cc:648] HybridClock initialized: now 1781993252203772 us; error 25 us; skew 500 ppm
Jun 20 22:07:32 dist-test-slave-xw35 krb5kdc[18211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:32.206283 18318 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:07:32.206692 18318 webserver.cc:460] Webserver started at http://127.1.55.193:40903/ using document root <none> and password file <none>
I20260620 22:07:32.206872 18318 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:32.206920 18318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:32.207006 18318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:32.207923 18318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "d2a19998c44a486dbebcf3f51ff9c82a"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "8c016945d805a9ac4090f8929551da99"
server_key_iv: "2704d9334b4a2b186c3f4b76a902fc41"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.208194 18318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "d2a19998c44a486dbebcf3f51ff9c82a"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "8c016945d805a9ac4090f8929551da99"
server_key_iv: "2704d9334b4a2b186c3f4b76a902fc41"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.209347 18318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:07:32.210021 18333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.210170 18318 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.210258 18318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "d2a19998c44a486dbebcf3f51ff9c82a"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "8c016945d805a9ac4090f8929551da99"
server_key_iv: "2704d9334b4a2b186c3f4b76a902fc41"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.210332 18318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:32.222189 18318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:32.224257 18318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:32.224400 18318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:32.224583 18318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:32.224855 18318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:32.224908 18318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.224946 18318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:32.224972 18318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.230782 18318 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:44763
I20260620 22:07:32.230825 18446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:44763 every 8 connection(s)
I20260620 22:07:32.231089 18318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
Jun 20 22:07:32 dist-test-slave-xw35 krb5kdc[18211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:32.239467 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.231730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:59655 (local address 127.1.55.254:38413)
0620 22:07:32.231787 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.231789 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.231945 (+ 156us) server_negotiation.cc:407] Connection header received
0620 22:07:32.232343 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.232344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.232356 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.232403 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:32.233185 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.233860 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.234777 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.234962 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.235014 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.236897 (+ 1883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:32.236898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:32.236899 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:32.236905 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:32.238107 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.238447 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.238448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.238448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.238494 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.238756 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.238757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.238757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.238921 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:32.239019 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.239290 (+ 271us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.239371 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 22:07:32.239655 18449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.231691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38413 (local address 127.1.55.193:59655)
0620 22:07:32.231857 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.231887 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:32.232267 (+ 380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:32.232446 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:32.232449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:32.232920 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:32.233098 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.233102 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.233934 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.233935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.234700 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.234702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.235040 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.235041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.235131 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.235578 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:32.235585 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:32.236803 (+ 1218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:32.238182 (+ 1379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:32.238187 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:32.238189 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:32.238387 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:32.238549 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:32.238549 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:32.238549 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:32.238634 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:32.238979 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:32.238986 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:32.239152 (+ 166us) client_negotiation.cc:769] Sending connection context
0620 22:07:32.239261 (+ 109us) client_negotiation.cc:240] Negotiation successful
0620 22:07:32.239431 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":108,"threads_started":1}
I20260620 22:07:32.240094 18447 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38413
I20260620 22:07:32.240190 18447 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:32.240337 18447 heartbeater.cc:511] Master 127.1.55.254:38413 requested a full tablet report, sending...
I20260620 22:07:32.240861 18256 ts_manager.cc:194] Registered new tserver with Master: d2a19998c44a486dbebcf3f51ff9c82a (127.1.55.193:44763)
I20260620 22:07:32.241211 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 18318
I20260620 22:07:32.241339 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:07:32.241585 1247 external_mini_cluster.cc:1428] Setting key a62b436ff22f83866abad2b8bf7bf0b3
I20260620 22:07:32.241677 18256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:59655
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:07:32.263895 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38413
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:32.338546 18452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:32.338735 18452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:32.338766 18452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:32.339871 18452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:32.339934 18452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:32.339977 18452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:07:32.341362 18452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:32.341624 18452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:32.341887 18452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:32.346524 18460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.346514 18458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:32.346671 18452 server_base.cc:1034] running on GCE node
W20260620 22:07:32.346514 18457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:32.346880 18452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:32.347157 18452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:32.348333 18452 hybrid_clock.cc:648] HybridClock initialized: now 1781993252348303 us; error 55 us; skew 500 ppm
Jun 20 22:07:32 dist-test-slave-xw35 krb5kdc[18211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:32.350636 18452 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:07:32.351038 18452 webserver.cc:460] Webserver started at http://127.1.55.194:38185/ using document root <none> and password file <none>
I20260620 22:07:32.351241 18452 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:32.351311 18452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:32.351450 18452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:32.352414 18452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "17af6fb39b5249f698bb3776bfb4a4eb"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "a99f9b95fd28a22e09814cf0a606821d"
server_key_iv: "0dff5396d1a630b012497766048cabca"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.352761 18452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "17af6fb39b5249f698bb3776bfb4a4eb"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "a99f9b95fd28a22e09814cf0a606821d"
server_key_iv: "0dff5396d1a630b012497766048cabca"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.354185 18452 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:07:32.354914 18467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.355072 18452 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.355165 18452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "17af6fb39b5249f698bb3776bfb4a4eb"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "a99f9b95fd28a22e09814cf0a606821d"
server_key_iv: "0dff5396d1a630b012497766048cabca"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.355240 18452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:32.367677 18452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:32.369323 18452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:32.369516 18452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:32.369721 18452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:32.369982 18452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:32.370033 18452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.370067 18452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:32.370093 18452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.375535 18452 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:44325
I20260620 22:07:32.375583 18580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:44325 every 8 connection(s)
I20260620 22:07:32.375859 18452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:07:32.377667 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 18452
I20260620 22:07:32.377769 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:07:32.377946 1247 external_mini_cluster.cc:1428] Setting key 83b5b1bfd702880423ab66da8c2ca837
Jun 20 22:07:32 dist-test-slave-xw35 krb5kdc[18211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:32.384871 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.376432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:44069 (local address 127.1.55.254:38413)
0620 22:07:32.376474 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.376477 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.376652 (+ 175us) server_negotiation.cc:407] Connection header received
0620 22:07:32.377125 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.377126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.377139 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.377189 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:32.378276 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.378970 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.379939 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.380176 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.380231 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.382233 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:32.382234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:32.382234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:32.382241 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:32.383565 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.383919 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.383920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.383920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.383976 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.384249 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.384250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.384251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.384360 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:32.384433 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.384687 (+ 254us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.384760 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:07:32.385061 18583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.376404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38413 (local address 127.1.55.194:44069)
0620 22:07:32.376534 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.376575 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:32.377027 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:32.377247 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:32.377251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:32.377883 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:32.378143 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.378149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.379055 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.379056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.379839 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.379842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.380262 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.380263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.380404 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.380855 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:32.380864 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:32.382147 (+ 1283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:32.383648 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:32.383654 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:32.383656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:32.383848 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:32.384037 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:32.384038 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:32.384038 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:32.384183 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:32.384424 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:32.384430 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:32.384555 (+ 125us) client_negotiation.cc:769] Sending connection context
0620 22:07:32.384656 (+ 101us) client_negotiation.cc:240] Negotiation successful
0620 22:07:32.384814 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":64,"threads_started":1}
I20260620 22:07:32.385426 18581 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38413
I20260620 22:07:32.385525 18581 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:32.385674 18581 heartbeater.cc:511] Master 127.1.55.254:38413 requested a full tablet report, sending...
I20260620 22:07:32.386015 18256 ts_manager.cc:194] Registered new tserver with Master: 17af6fb39b5249f698bb3776bfb4a4eb (127.1.55.194:44325)
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
I20260620 22:07:32.386428 18256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:44069
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:07:32.401441 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38413
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:32.478335 18586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:32.478543 18586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:32.478580 18586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:32.479723 18586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:32.479797 18586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:32.479843 18586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:07:32.481226 18586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:32.481457 18586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:32.481670 18586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:32.486027 18594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.486073 18591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.486073 18592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:32.486202 18586 server_base.cc:1034] running on GCE node
I20260620 22:07:32.486413 18586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:32.486644 18586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:32.487823 18586 hybrid_clock.cc:648] HybridClock initialized: now 1781993252487808 us; error 34 us; skew 500 ppm
Jun 20 22:07:32 dist-test-slave-xw35 krb5kdc[18211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:32.490299 18586 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:07:32.490741 18586 webserver.cc:460] Webserver started at http://127.1.55.195:33705/ using document root <none> and password file <none>
I20260620 22:07:32.490962 18586 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:32.491026 18586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:32.491173 18586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:32.492127 18586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "f2cd3c25c4ff447f849f51bf75c67ffe"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "7fc15d104240428aff587f25d4fb2ae3"
server_key_iv: "528653ad28d2eb31e0fbf9c0804107b5"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.492465 18586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "f2cd3c25c4ff447f849f51bf75c67ffe"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "7fc15d104240428aff587f25d4fb2ae3"
server_key_iv: "528653ad28d2eb31e0fbf9c0804107b5"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.493791 18586 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:32.494460 18601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.494632 18586 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:32.494724 18586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "f2cd3c25c4ff447f849f51bf75c67ffe"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "7fc15d104240428aff587f25d4fb2ae3"
server_key_iv: "528653ad28d2eb31e0fbf9c0804107b5"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.494832 18586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:32.501464 18586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:32.503633 18586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:32.503798 18586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:32.503996 18586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:32.504249 18586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:32.504302 18586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.504339 18586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:32.504365 18586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.510070 18586 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:46779
I20260620 22:07:32.510102 18714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:46779 every 8 connection(s)
I20260620 22:07:32.510370 18586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:07:32.515074 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 18586
I20260620 22:07:32.515178 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:07:32.515363 1247 external_mini_cluster.cc:1428] Setting key 55eb773a686a68a0d572550ffed100c9
Jun 20 22:07:32 dist-test-slave-xw35 krb5kdc[18211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993252, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:32.518823 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.511034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:45297 (local address 127.1.55.254:38413)
0620 22:07:32.511093 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.511095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.511267 (+ 172us) server_negotiation.cc:407] Connection header received
0620 22:07:32.511639 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.511640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.511648 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.511705 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:32.512471 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.512946 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.514084 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.514270 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.514336 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.516595 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:32.516596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:32.516596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:32.516602 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:32.517809 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.518152 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.518153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.518153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.518200 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.518396 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.518397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.518397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.518486 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:32.518532 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.518715 (+ 183us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.518764 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 22:07:32.518975 18717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.510970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38413 (local address 127.1.55.195:45297)
0620 22:07:32.511145 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.511180 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:32.511564 (+ 384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:32.511759 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:32.511762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:32.512222 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:32.512375 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.512378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.513020 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.513021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.514014 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.514016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.514351 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.514351 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.514432 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.514832 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:32.514866 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:32.516534 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:32.517875 (+ 1341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:32.517880 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:32.517882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:32.518075 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:32.518253 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:32.518254 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:32.518254 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:32.518344 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:32.518536 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:32.518540 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:32.518630 (+ 90us) client_negotiation.cc:769] Sending connection context
0620 22:07:32.518703 (+ 73us) client_negotiation.cc:240] Negotiation successful
0620 22:07:32.518800 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260620 22:07:32.519411 18715 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38413
I20260620 22:07:32.519475 18715 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:32.519585 18715 heartbeater.cc:511] Master 127.1.55.254:38413 requested a full tablet report, sending...
I20260620 22:07:32.519826 18256 ts_manager.cc:194] Registered new tserver with Master: f2cd3c25c4ff447f849f51bf75c67ffe (127.1.55.195:46779)
I20260620 22:07:32.520150 18256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:45297
I20260620 22:07:32.527184 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:07:32.533583 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.528451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37540 (local address 127.1.55.254:38413)
0620 22:07:32.528483 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.528484 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.528598 (+ 114us) server_negotiation.cc:407] Connection header received
0620 22:07:32.528632 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.528632 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.528640 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.528686 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:32.529164 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.529599 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.530232 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.530412 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.530455 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.531366 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:32.531367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:32.531367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:32.531372 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:32.532684 (+ 1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.532957 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.532958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.532958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.532999 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:32.533141 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:32.533142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:32.533142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:32.533238 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:32.533296 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.533407 (+ 111us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.533461 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:07:32.534885 18256 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:07:32.536278 18256 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:07:32.541867 18728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.538483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53058 (local address 127.1.55.195:46779)
0620 22:07:32.538648 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.538651 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.538852 (+ 201us) server_negotiation.cc:407] Connection header received
0620 22:07:32.538884 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.538886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.538898 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.538958 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:32.539118 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.539983 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.540962 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.541510 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.541577 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.541627 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.541768 (+ 141us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.541800 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260620 22:07:32.541877 18723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.538353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:46779 (local address 127.0.0.1:53058)
0620 22:07:32.538719 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.538734 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:32.538794 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:32.539013 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:32.539014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:32.539016 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:32.539057 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.539058 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.540112 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.540113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.540873 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.540875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.541585 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.541586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.541658 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.541669 (+ 11us) client_negotiation.cc:769] Sending connection context
0620 22:07:32.541754 (+ 85us) client_negotiation.cc:240] Negotiation successful
0620 22:07:32.541800 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":52,"threads_started":1}
I20260620 22:07:32.542285 18724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.538182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:44763 (local address 127.0.0.1:43126)
0620 22:07:32.538318 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.538361 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:32.538414 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:32.538654 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:32.538656 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:32.538658 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:32.538725 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.538726 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.539937 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.539938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.541077 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.541079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.542048 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.542049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.542121 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.542123 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:07:32.542172 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:07:32.542215 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":34,"thread_start_us":57,"threads_started":1}
I20260620 22:07:32.542308 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.538299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43126 (local address 127.1.55.193:44763)
0620 22:07:32.538468 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.538472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.538480 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:07:32.538511 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.538513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.538549 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.538632 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:32.538800 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.539835 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.541168 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.541892 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.541963 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.542012 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.542191 (+ 179us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.542241 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":65,"threads_started":1}
I20260620 22:07:32.542392 18726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.538320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40224 (local address 127.1.55.194:44325)
0620 22:07:32.538694 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.538699 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.538709 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:07:32.538744 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.538746 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.538760 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.538850 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:32.538980 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.539690 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.541262 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.541919 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.541970 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.542012 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.542253 (+ 241us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.542304 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":78,"threads_started":1}
I20260620 22:07:32.542665 18727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.538210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:44325 (local address 127.0.0.1:40224)
0620 22:07:32.538504 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.538513 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:32.538579 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:32.538856 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:32.538856 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:32.538858 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:32.538889 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.538890 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.539804 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.539805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.541060 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.541063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.542047 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.542048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.542119 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.542122 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:32.542168 (+ 46us) client_negotiation.cc:240] Negotiation successful
0620 22:07:32.542215 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":5,"thread_start_us":39,"threads_started":1}
I20260620 22:07:32.542704 18649 tablet_service.cc:1467] Processing CreateTablet for tablet 50244e56e2a24d6f8fc9109df8df5f8d (DEFAULT_TABLE table=test-table [id=cdc92bd44e05461ebf5406baca3a9d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:32.543049 18649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50244e56e2a24d6f8fc9109df8df5f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:32.543390 18381 tablet_service.cc:1467] Processing CreateTablet for tablet 50244e56e2a24d6f8fc9109df8df5f8d (DEFAULT_TABLE table=test-table [id=cdc92bd44e05461ebf5406baca3a9d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:32.543689 18381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50244e56e2a24d6f8fc9109df8df5f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:32.545490 18729 tablet_bootstrap.cc:492] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Bootstrap starting.
I20260620 22:07:32.545970 18515 tablet_service.cc:1467] Processing CreateTablet for tablet 50244e56e2a24d6f8fc9109df8df5f8d (DEFAULT_TABLE table=test-table [id=cdc92bd44e05461ebf5406baca3a9d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:32.546200 18729 tablet_bootstrap.cc:654] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:32.546319 18515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50244e56e2a24d6f8fc9109df8df5f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:32.546483 18730 tablet_bootstrap.cc:492] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a: Bootstrap starting.
I20260620 22:07:32.546747 18729 log.cc:824] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:32.547098 18730 tablet_bootstrap.cc:654] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:32.547564 18729 tablet_bootstrap.cc:492] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: No bootstrap required, opened a new log
I20260620 22:07:32.547622 18729 ts_tablet_manager.cc:1397] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:07:32.547616 18730 log.cc:824] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:32.548384 18730 tablet_bootstrap.cc:492] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a: No bootstrap required, opened a new log
I20260620 22:07:32.548440 18730 ts_tablet_manager.cc:1397] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:32.548887 18733 tablet_bootstrap.cc:492] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Bootstrap starting.
I20260620 22:07:32.549643 18733 tablet_bootstrap.cc:654] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:32.549628 18729 raft_consensus.cc:348] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.549853 18729 raft_consensus.cc:374] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:32.549926 18729 raft_consensus.cc:729] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2cd3c25c4ff447f849f51bf75c67ffe, State: Initialized, Role: FOLLOWER
I20260620 22:07:32.550077 18729 consensus_queue.cc:260] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.550241 18733 log.cc:824] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:32.550385 18715 heartbeater.cc:503] Master 127.1.55.254:38413 was elected leader, sending a full tablet report...
I20260620 22:07:32.550427 18730 raft_consensus.cc:348] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.550379 18729 ts_tablet_manager.cc:1428] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260620 22:07:32.550562 18730 raft_consensus.cc:374] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:32.550740 18730 raft_consensus.cc:729] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2a19998c44a486dbebcf3f51ff9c82a, State: Initialized, Role: FOLLOWER
I20260620 22:07:32.550868 18730 consensus_queue.cc:260] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.551128 18730 ts_tablet_manager.cc:1428] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:07:32.551236 18447 heartbeater.cc:503] Master 127.1.55.254:38413 was elected leader, sending a full tablet report...
I20260620 22:07:32.551297 18733 tablet_bootstrap.cc:492] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: No bootstrap required, opened a new log
I20260620 22:07:32.551523 18733 ts_tablet_manager.cc:1397] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260620 22:07:32.553184 18733 raft_consensus.cc:348] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.553323 18733 raft_consensus.cc:374] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:32.553359 18733 raft_consensus.cc:729] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17af6fb39b5249f698bb3776bfb4a4eb, State: Initialized, Role: FOLLOWER
I20260620 22:07:32.553462 18733 consensus_queue.cc:260] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.553740 18733 ts_tablet_manager.cc:1428] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:07:32.553791 18581 heartbeater.cc:503] Master 127.1.55.254:38413 was elected leader, sending a full tablet report...
W20260620 22:07:32.626358 18582 tablet.cc:2369] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:07:32.715165 18737 raft_consensus.cc:482] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:32.715313 18737 raft_consensus.cc:504] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.715756 18737 leader_election.cc:288] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2a19998c44a486dbebcf3f51ff9c82a (127.1.55.193:44763), f2cd3c25c4ff447f849f51bf75c67ffe (127.1.55.195:46779)
I20260620 22:07:32.718816 18725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.716006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:50887 (local address 127.1.55.193:44763)
0620 22:07:32.716078 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.716080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.716213 (+ 133us) server_negotiation.cc:407] Connection header received
0620 22:07:32.716245 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.716250 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.716262 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.716326 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:32.716495 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.717031 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.718090 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.718446 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.718510 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.718516 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.718686 (+ 170us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.718739 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260620 22:07:32.718814 18583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.715970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:44763 (local address 127.1.55.194:50887)
0620 22:07:32.716019 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.716067 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:32.716142 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:32.716328 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:32.716330 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:32.716331 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:32.716408 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.716410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.717103 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.717104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.717999 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.718002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.718531 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.718532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.718610 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.718614 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:07:32.718673 (+ 59us) client_negotiation.cc:240] Negotiation successful
0620 22:07:32.718729 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260620 22:07:32.718912 18728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.716143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:56767 (local address 127.1.55.195:46779)
0620 22:07:32.716194 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.716197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.716306 (+ 109us) server_negotiation.cc:407] Connection header received
0620 22:07:32.716360 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.716361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.716370 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.716436 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:32.716582 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.717102 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.718142 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.718537 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.718603 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.718611 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.718797 (+ 186us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.718839 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:07:32.719045 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.716091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:46779 (local address 127.1.55.194:56767)
0620 22:07:32.716236 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.716245 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:32.716302 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:32.716455 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:32.716455 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:32.716457 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:32.716530 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.716531 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.717200 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.717201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.718026 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:32.718028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.718613 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.718614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:32.718717 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.718721 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:07:32.718775 (+ 54us) client_negotiation.cc:240] Negotiation successful
0620 22:07:32.718810 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
I20260620 22:07:32.719225 18401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50244e56e2a24d6f8fc9109df8df5f8d" candidate_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" is_pre_election: true
I20260620 22:07:32.719434 18401 raft_consensus.cc:2454] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17af6fb39b5249f698bb3776bfb4a4eb in term 0.
I20260620 22:07:32.719457 18669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50244e56e2a24d6f8fc9109df8df5f8d" candidate_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" is_pre_election: true
I20260620 22:07:32.719614 18669 raft_consensus.cc:2454] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17af6fb39b5249f698bb3776bfb4a4eb in term 0.
I20260620 22:07:32.719651 18470 leader_election.cc:302] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17af6fb39b5249f698bb3776bfb4a4eb, d2a19998c44a486dbebcf3f51ff9c82a; no voters:
I20260620 22:07:32.719841 18737 raft_consensus.cc:2781] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:07:32.719883 18737 raft_consensus.cc:482] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:07:32.719898 18737 raft_consensus.cc:3037] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:32.720534 18737 raft_consensus.cc:504] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.720664 18737 leader_election.cc:288] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [CANDIDATE]: Term 1 election: Requested vote from peers d2a19998c44a486dbebcf3f51ff9c82a (127.1.55.193:44763), f2cd3c25c4ff447f849f51bf75c67ffe (127.1.55.195:46779)
I20260620 22:07:32.720781 18401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50244e56e2a24d6f8fc9109df8df5f8d" candidate_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2a19998c44a486dbebcf3f51ff9c82a"
I20260620 22:07:32.720822 18669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50244e56e2a24d6f8fc9109df8df5f8d" candidate_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe"
I20260620 22:07:32.720880 18401 raft_consensus.cc:3037] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:32.720885 18669 raft_consensus.cc:3037] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:32.721637 18669 raft_consensus.cc:2454] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17af6fb39b5249f698bb3776bfb4a4eb in term 1.
I20260620 22:07:32.721694 18401 raft_consensus.cc:2454] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17af6fb39b5249f698bb3776bfb4a4eb in term 1.
I20260620 22:07:32.721808 18470 leader_election.cc:302] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17af6fb39b5249f698bb3776bfb4a4eb, f2cd3c25c4ff447f849f51bf75c67ffe; no voters:
I20260620 22:07:32.721937 18737 raft_consensus.cc:2781] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:32.722096 18737 raft_consensus.cc:686] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 1 LEADER]: Becoming Leader. State: Replica: 17af6fb39b5249f698bb3776bfb4a4eb, State: Running, Role: LEADER
I20260620 22:07:32.722209 18737 consensus_queue.cc:237] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } }
I20260620 22:07:32.722983 18256 catalog_manager.cc:5495] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 17af6fb39b5249f698bb3776bfb4a4eb (127.1.55.194). New cstate: current_term: 1 leader_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17af6fb39b5249f698bb3776bfb4a4eb" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 } health_report { overall_health: UNKNOWN } } }
W20260620 22:07:32.731766 18448 tablet.cc:2369] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260620 22:07:32.760872 18716 tablet.cc:2369] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:07:32.766037 18726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.763827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40240 (local address 127.1.55.194:44325)
0620 22:07:32.763887 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.763889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.763896 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:07:32.763934 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.763935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.763949 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.764003 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:07:32.764139 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.764606 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.765307 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.765512 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.765576 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.765694 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:07:32.765804 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:07:32.765868 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.765910 (+ 42us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.765924 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260620 22:07:32.767704 18669 raft_consensus.cc:1261] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 1 FOLLOWER]: Refusing update from remote peer 17af6fb39b5249f698bb3776bfb4a4eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:32.767771 18401 raft_consensus.cc:1261] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [term 1 FOLLOWER]: Refusing update from remote peer 17af6fb39b5249f698bb3776bfb4a4eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:32.768079 18739 consensus_queue.cc:1035] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2cd3c25c4ff447f849f51bf75c67ffe" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:32.768186 18737 consensus_queue.cc:1035] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2a19998c44a486dbebcf3f51ff9c82a" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 44763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:32.772377 18743 mvcc.cc:205] Tried to move back new op lower bound from 7299044363333894144 to 7299044363150622720. Current Snapshot: MvccSnapshot[applied={T|T < 7299044363333894144 or (T in {7299044363333894144})}]
I20260620 22:07:32.772356 18254 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:32.772464 18254 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:32.773211 18254 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8ad7138dbfd647b586ddfc6bfd08a09b: Sending DeleteTablet for 3 replicas of tablet 50244e56e2a24d6f8fc9109df8df5f8d
I20260620 22:07:32.773558 18515 tablet_service.cc:1514] Processing DeleteTablet for tablet 50244e56e2a24d6f8fc9109df8df5f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:32 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:40224
I20260620 22:07:32.773554 18381 tablet_service.cc:1514] Processing DeleteTablet for tablet 50244e56e2a24d6f8fc9109df8df5f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:32 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:43126
I20260620 22:07:32.773571 18649 tablet_service.cc:1514] Processing DeleteTablet for tablet 50244e56e2a24d6f8fc9109df8df5f8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:32 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:53058
I20260620 22:07:32.773803 18752 tablet_replica.cc:330] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: stopping tablet replica
I20260620 22:07:32.773943 18753 tablet_replica.cc:330] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a: stopping tablet replica
I20260620 22:07:32.773958 18751 tablet_replica.cc:330] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: stopping tablet replica
I20260620 22:07:32.774044 18751 raft_consensus.cc:2229] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:32.774068 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 18318
I20260620 22:07:32.774081 18753 raft_consensus.cc:2229] T 50244e56e2a24d6f8fc9109df8df5f8d P d2a19998c44a486dbebcf3f51ff9c82a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:32.775380 18751 raft_consensus.cc:2258] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:32.775800 18751 ts_tablet_manager.cc:1905] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:32.776460 18752 raft_consensus.cc:2229] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:07:32.776571 18752 raft_consensus.cc:2258] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:32.777530 18751 ts_tablet_manager.cc:1918] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:32.777666 18751 log.cc:1196] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/50244e56e2a24d6f8fc9109df8df5f8d
I20260620 22:07:32.777828 18752 ts_tablet_manager.cc:1905] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:32.778039 18751 ts_tablet_manager.cc:1939] T 50244e56e2a24d6f8fc9109df8df5f8d P f2cd3c25c4ff447f849f51bf75c67ffe: Deleting consensus metadata
I20260620 22:07:32.778455 18242 catalog_manager.cc:4841] TS f2cd3c25c4ff447f849f51bf75c67ffe (127.1.55.195:46779): tablet 50244e56e2a24d6f8fc9109df8df5f8d (table test-table [id=cdc92bd44e05461ebf5406baca3a9d2f]) successfully deleted
I20260620 22:07:32.779402 18752 ts_tablet_manager.cc:1918] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:32.779491 18752 log.cc:1196] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/50244e56e2a24d6f8fc9109df8df5f8d
I20260620 22:07:32.779767 18752 ts_tablet_manager.cc:1939] T 50244e56e2a24d6f8fc9109df8df5f8d P 17af6fb39b5249f698bb3776bfb4a4eb: Deleting consensus metadata
I20260620 22:07:32.780129 18241 catalog_manager.cc:4841] TS 17af6fb39b5249f698bb3776bfb4a4eb (127.1.55.194:44325): tablet 50244e56e2a24d6f8fc9109df8df5f8d (table test-table [id=cdc92bd44e05461ebf5406baca3a9d2f]) successfully deleted
W20260620 22:07:32.780483 18242 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:44763 (error 108)
I20260620 22:07:32.780694 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 18452
I20260620 22:07:32.781232 18727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.780822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:44763 (local address 127.0.0.1:43134)
0620 22:07:32.781174 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:32.781204 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:44763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335}
W20260620 22:07:32.781338 18242 catalog_manager.cc:4584] TS d2a19998c44a486dbebcf3f51ff9c82a (127.1.55.193:44763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 50244e56e2a24d6f8fc9109df8df5f8d: Network error: Client connection negotiation failed: client connection to 127.1.55.193:44763: connect: Connection refused (error 111)
I20260620 22:07:32.785194 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 18586
I20260620 22:07:32.789191 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 18224
2026-06-20T22:07:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1993 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-06-20T22:07:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:32Z Disabled control of system clock
I20260620 22:07:32.815922 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:33059
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:36291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:33059
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:32.890085 18758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:32.890264 18758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:32.890281 18758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:32.891290 18758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:32.891323 18758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:32.891335 18758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:32.891345 18758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:32.891355 18758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:32.892449 18758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:33059
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:33059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:32.892608 18758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:32.892798 18758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:32.896924 18766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.896960 18763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:32.897027 18764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:32.897189 18758 server_base.cc:1034] running on GCE node
I20260620 22:07:32.897387 18758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:32.897683 18758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:32.898844 18758 hybrid_clock.cc:648] HybridClock initialized: now 1781993252898848 us; error 47 us; skew 500 ppm
I20260620 22:07:32.899905 18758 webserver.cc:460] Webserver started at http://127.1.55.254:46483/ using document root <none> and password file <none>
I20260620 22:07:32.900104 18758 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:32.900166 18758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:32.900293 18758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:32.901157 18758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "bdc92e63411d4e739900ad0d04cb7aeb"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "d882a042bfe76b4e07a2ec88cff25068"
server_key_iv: "94294e830d02ba2561177301aed4c7b8"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.901510 18758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "bdc92e63411d4e739900ad0d04cb7aeb"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "d882a042bfe76b4e07a2ec88cff25068"
server_key_iv: "94294e830d02ba2561177301aed4c7b8"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.902613 18758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:32.903298 18772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.903453 18758 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:32.903538 18758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "bdc92e63411d4e739900ad0d04cb7aeb"
format_stamp: "Formatted at 2026-06-20 22:07:32 on dist-test-slave-xw35"
server_key: "d882a042bfe76b4e07a2ec88cff25068"
server_key_iv: "94294e830d02ba2561177301aed4c7b8"
server_key_version: "encryptionkey@0"
I20260620 22:07:32.903615 18758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:32.922626 18758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:32.922859 18758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:32.922989 18758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:32.926373 18758 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:33059
I20260620 22:07:32.926406 18824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:33059 every 8 connection(s)
I20260620 22:07:32.926708 18758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:32.927606 18825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:32.929740 18825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb: Bootstrap starting.
I20260620 22:07:32.929874 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 18758
I20260620 22:07:32.929975 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:32.930145 1247 external_mini_cluster.cc:1428] Setting key f2a88a6895cd41642d88c6a2e5d87a42
I20260620 22:07:32.930445 18825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:32.930912 18825 log.cc:824] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:32.931535 18825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb: No bootstrap required, opened a new log
I20260620 22:07:32.933136 18825 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc92e63411d4e739900ad0d04cb7aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33059 } }
I20260620 22:07:32.933252 18825 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:32.933281 18825 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdc92e63411d4e739900ad0d04cb7aeb, State: Initialized, Role: FOLLOWER
I20260620 22:07:32.933429 18825 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc92e63411d4e739900ad0d04cb7aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33059 } }
I20260620 22:07:32.933529 18825 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:32.933571 18825 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:32.933619 18825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:32.934198 18825 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc92e63411d4e739900ad0d04cb7aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33059 } }
I20260620 22:07:32.934335 18825 leader_election.cc:302] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdc92e63411d4e739900ad0d04cb7aeb; no voters:
I20260620 22:07:32.934526 18825 leader_election.cc:288] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:32.934569 18830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:32.934725 18830 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [term 1 LEADER]: Becoming Leader. State: Replica: bdc92e63411d4e739900ad0d04cb7aeb, State: Running, Role: LEADER
I20260620 22:07:32.934780 18825 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:32.934868 18830 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc92e63411d4e739900ad0d04cb7aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33059 } }
I20260620 22:07:32.935105 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:32.930572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54012 (local address 127.1.55.254:33059)
0620 22:07:32.930774 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:32.930781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:32.930802 (+ 21us) server_negotiation.cc:407] Connection header received
0620 22:07:32.931177 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:32.931183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:32.931230 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:32.931356 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:32.931539 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.932312 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.933028 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:32.933513 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:32.933624 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:32.934375 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:32.934378 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:32.934378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:32.934579 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:32.934615 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:32.934627 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:32.934847 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:32.934876 (+ 29us) server_negotiation.cc:299] Negotiation successful
0620 22:07:32.934941 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
I20260620 22:07:32.935226 18830 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdc92e63411d4e739900ad0d04cb7aeb. Latest consensus state: current_term: 1 leader_uuid: "bdc92e63411d4e739900ad0d04cb7aeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc92e63411d4e739900ad0d04cb7aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33059 } } }
I20260620 22:07:32.935292 18830 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:32.935429 18831 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdc92e63411d4e739900ad0d04cb7aeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdc92e63411d4e739900ad0d04cb7aeb" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 33059 } } }
I20260620 22:07:32.935511 18835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:32.935550 18831 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:32.936113 18835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:32.937847 18835 catalog_manager.cc:1347] Generated new cluster ID: 5bfff7e82d854546953a483a710f8313
I20260620 22:07:32.937896 18835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:32.952541 18835 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:32.953019 18835 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:32.959599 18835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb: Generated new TSK 0
I20260620 22:07:32.959753 18835 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:32.966969 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33059
--builtin_ntp_servers=127.1.55.212:36291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:33.042066 18849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:33.042232 18849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:33.042251 18849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:33.043352 18849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:33.043385 18849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:33.043406 18849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:07:33.044690 18849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:33.044924 18849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:33.045194 18849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:33.050532 18854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:33.050544 18855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:33.050736 18849 server_base.cc:1034] running on GCE node
W20260620 22:07:33.050544 18857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:33.051007 18849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:33.051237 18849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:33.052376 18849 hybrid_clock.cc:648] HybridClock initialized: now 1781993253052360 us; error 30 us; skew 500 ppm
I20260620 22:07:33.053517 18849 webserver.cc:460] Webserver started at http://127.1.55.193:43035/ using document root <none> and password file <none>
I20260620 22:07:33.053714 18849 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:33.053747 18849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:33.053846 18849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:33.054656 18849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "2759c024f9af4aaca5d4c6aee678dcc1"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "ab6ef811db0c83b5d1602c7231174be1"
server_key_iv: "9f13c4762342e9abedc12b4ea0afac98"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.054920 18849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "2759c024f9af4aaca5d4c6aee678dcc1"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "ab6ef811db0c83b5d1602c7231174be1"
server_key_iv: "9f13c4762342e9abedc12b4ea0afac98"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.056023 18849 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:33.056627 18863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.056809 18849 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:33.056867 18849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "2759c024f9af4aaca5d4c6aee678dcc1"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "ab6ef811db0c83b5d1602c7231174be1"
server_key_iv: "9f13c4762342e9abedc12b4ea0afac98"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.056914 18849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:33.081451 18849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:33.081698 18849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:33.081784 18849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:33.081938 18849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:33.082170 18849 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:33.082196 18849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.082214 18849 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:33.082226 18849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.087309 18849 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:33313
I20260620 22:07:33.087414 18976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:33313 every 8 connection(s)
I20260620 22:07:33.087600 18849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:07:33.091845 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 18849
I20260620 22:07:33.091960 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:07:33.092193 1247 external_mini_cluster.cc:1428] Setting key 8144d23bf126a99ffb4a06581b3d61cb
I20260620 22:07:33.092551 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.088309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:54127 (local address 127.1.55.254:33059)
0620 22:07:33.088371 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.088373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.088586 (+ 213us) server_negotiation.cc:407] Connection header received
0620 22:07:33.089075 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.089077 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.089088 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.089137 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:33.089782 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.090249 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.091186 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.091372 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.091450 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.092266 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:33.092268 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:33.092268 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:33.092272 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:33.092286 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:33.092291 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:33.092365 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.092454 (+ 89us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.092480 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 22:07:33.092788 18979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.088300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33059 (local address 127.1.55.193:54127)
0620 22:07:33.088478 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.088505 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:33.088966 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:33.089196 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:33.089200 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:33.089208 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:33.089696 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.089701 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.090342 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.090344 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.091085 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.091087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.091458 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.091459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.091577 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.092128 (+ 551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:33.092129 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:33.092160 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:33.092180 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:33.092369 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:33.092374 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:33.092377 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:33.092456 (+ 79us) client_negotiation.cc:240] Negotiation successful
0620 22:07:33.092542 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":60,"threads_started":1}
I20260620 22:07:33.093183 18977 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33059
I20260620 22:07:33.093190 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33059
--builtin_ntp_servers=127.1.55.212:36291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260620 22:07:33.093259 18977 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:33.093441 18977 heartbeater.cc:511] Master 127.1.55.254:33059 requested a full tablet report, sending...
I20260620 22:07:33.093942 18789 ts_manager.cc:194] Registered new tserver with Master: 2759c024f9af4aaca5d4c6aee678dcc1 (127.1.55.193:33313)
I20260620 22:07:33.094700 18789 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.193:54127
W20260620 22:07:33.165210 18980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:33.165382 18980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:33.165402 18980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:33.166522 18980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:33.166558 18980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:33.166582 18980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:07:33.167743 18980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:33.167923 18980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:33.168120 18980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:33.172407 18988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:33.172412 18985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:33.172493 18980 server_base.cc:1034] running on GCE node
W20260620 22:07:33.172415 18986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:33.172750 18980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:33.172981 18980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:33.174110 18980 hybrid_clock.cc:648] HybridClock initialized: now 1781993253174084 us; error 40 us; skew 500 ppm
I20260620 22:07:33.175249 18980 webserver.cc:460] Webserver started at http://127.1.55.194:37263/ using document root <none> and password file <none>
I20260620 22:07:33.175470 18980 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:33.175513 18980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:33.175642 18980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:33.176635 18980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "bab51c255946408bb382af9966c3b8c2"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "bcd04adf5944a6fec51c597e0d382add"
server_key_iv: "48e182f08bad5bd04d523233c59dfed9"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.176990 18980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "bab51c255946408bb382af9966c3b8c2"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "bcd04adf5944a6fec51c597e0d382add"
server_key_iv: "48e182f08bad5bd04d523233c59dfed9"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.178200 18980 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:33.178900 18994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.179072 18980 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:33.179154 18980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "bab51c255946408bb382af9966c3b8c2"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "bcd04adf5944a6fec51c597e0d382add"
server_key_iv: "48e182f08bad5bd04d523233c59dfed9"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.179220 18980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:33.191926 18980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:33.192153 18980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:33.192282 18980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:33.192478 18980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:33.192731 18980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:33.192767 18980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.192816 18980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:33.192844 18980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.198053 18980 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:33817
I20260620 22:07:33.198133 19107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:33817 every 8 connection(s)
I20260620 22:07:33.198376 18980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:07:33.202404 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.198897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:41751 (local address 127.1.55.254:33059)
0620 22:07:33.198952 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.198954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.199141 (+ 187us) server_negotiation.cc:407] Connection header received
0620 22:07:33.199512 (+ 371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.199513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.199522 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.199568 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:33.200079 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.200507 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.201316 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.201518 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.201591 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.202218 (+ 627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:33.202219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:33.202220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:33.202223 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:33.202234 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:33.202237 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:33.202273 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.202336 (+ 63us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.202354 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:07:33.202566 19110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.198903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33059 (local address 127.1.55.194:41751)
0620 22:07:33.199054 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.199080 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:33.199434 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:33.199616 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:33.199618 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:33.199625 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:33.200013 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.200016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.200579 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.200580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.201237 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.201238 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.201607 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.201608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.201699 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.202091 (+ 392us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:33.202092 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:33.202114 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:33.202132 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:33.202277 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:33.202279 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:33.202281 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:07:33.202320 (+ 39us) client_negotiation.cc:240] Negotiation successful
0620 22:07:33.202381 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
I20260620 22:07:33.203016 19108 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33059
I20260620 22:07:33.203079 19108 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:33.203224 19108 heartbeater.cc:511] Master 127.1.55.254:33059 requested a full tablet report, sending...
I20260620 22:07:33.203539 18789 ts_manager.cc:194] Registered new tserver with Master: bab51c255946408bb382af9966c3b8c2 (127.1.55.194:33817)
I20260620 22:07:33.203855 18789 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.194:41751
I20260620 22:07:33.207625 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 18980
I20260620 22:07:33.207700 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:07:33.207864 1247 external_mini_cluster.cc:1428] Setting key 96fa60f5736e8cd4ef367354271200f7
I20260620 22:07:33.208684 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33059
--builtin_ntp_servers=127.1.55.212:36291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:33.281778 19111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:33.281934 19111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:33.281952 19111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:33.283002 19111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:33.283038 19111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:33.283061 19111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:07:33.284436 19111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:36291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:33059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:33.284669 19111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:33.284998 19111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:33.289649 19116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:33.289708 19111 server_base.cc:1034] running on GCE node
W20260620 22:07:33.289656 19117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:33.289664 19119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:33.290165 19111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:33.290386 19111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:33.291536 19111 hybrid_clock.cc:648] HybridClock initialized: now 1781993253291528 us; error 25 us; skew 500 ppm
I20260620 22:07:33.292804 19111 webserver.cc:460] Webserver started at http://127.1.55.195:41435/ using document root <none> and password file <none>
I20260620 22:07:33.293025 19111 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:33.293092 19111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:33.293215 19111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:33.294250 19111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "37af5f3f483a45afbf99645bc7ae0352"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "10cda53ef049e229fee978a90642e13f"
server_key_iv: "27dd053c271b1d0500ead35f4939e551"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.294613 19111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "37af5f3f483a45afbf99645bc7ae0352"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "10cda53ef049e229fee978a90642e13f"
server_key_iv: "27dd053c271b1d0500ead35f4939e551"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.295845 19111 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:07:33.296485 19125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.296631 19111 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:33.296738 19111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "37af5f3f483a45afbf99645bc7ae0352"
format_stamp: "Formatted at 2026-06-20 22:07:33 on dist-test-slave-xw35"
server_key: "10cda53ef049e229fee978a90642e13f"
server_key_iv: "27dd053c271b1d0500ead35f4939e551"
server_key_version: "encryptionkey@0"
I20260620 22:07:33.296825 19111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:33.315791 19111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:33.316069 19111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:33.316211 19111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:33.316417 19111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:33.316702 19111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:33.316756 19111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.316795 19111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:33.316816 19111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:33.321834 19111 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:41083
I20260620 22:07:33.321871 19238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:41083 every 8 connection(s)
I20260620 22:07:33.322134 19111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:07:33.322991 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 19111
I20260620 22:07:33.323086 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:07:33.323263 1247 external_mini_cluster.cc:1428] Setting key 3ae78f14da63c803d4c352832c68cb15
I20260620 22:07:33.326771 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.322744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:52737 (local address 127.1.55.254:33059)
0620 22:07:33.322800 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.322802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.323032 (+ 230us) server_negotiation.cc:407] Connection header received
0620 22:07:33.323575 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.323576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.323586 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.323635 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:33.324292 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.324741 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.325678 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.325866 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.325919 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.326571 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:33.326572 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:33.326573 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:33.326577 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:33.326591 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:33.326594 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:33.326637 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.326699 (+ 62us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.326718 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 22:07:33.326941 19241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.322724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:33059 (local address 127.1.55.195:52737)
0620 22:07:33.322924 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.322962 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:33.323481 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:33.323692 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:33.323696 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:33.323705 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:33.324230 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.324234 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.324811 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.324812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.325617 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.325619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.325938 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.325939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.326033 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.326458 (+ 425us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:33.326458 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:33.326481 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:33.326499 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:33.326647 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:33.326651 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:33.326653 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:07:33.326701 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 22:07:33.326767 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260620 22:07:33.327390 19239 heartbeater.cc:347] Connected to a master server at 127.1.55.254:33059
I20260620 22:07:33.327459 19239 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:33.327622 19239 heartbeater.cc:511] Master 127.1.55.254:33059 requested a full tablet report, sending...
I20260620 22:07:33.328014 18789 ts_manager.cc:194] Registered new tserver with Master: 37af5f3f483a45afbf99645bc7ae0352 (127.1.55.195:41083)
I20260620 22:07:33.328318 18789 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.195:52737
I20260620 22:07:33.334844 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:07:33.338608 18828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.336261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54020 (local address 127.1.55.254:33059)
0620 22:07:33.336306 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.336307 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.336406 (+ 99us) server_negotiation.cc:407] Connection header received
0620 22:07:33.336462 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.336463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.336470 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.336510 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:33.336656 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.337097 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.337773 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.337929 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.338007 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.338449 (+ 442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:33.338450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:33.338450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:33.338453 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:33.338463 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:33.338466 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:33.338503 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.338551 (+ 48us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.338567 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:07:33.340001 18789 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:07:33.341271 18789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:07:33.347353 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.343102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59350 (local address 127.1.55.193:33313)
0620 22:07:33.343398 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.343402 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.343412 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:07:33.343508 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.343510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.343523 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.343568 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:33.343801 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.344860 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.346117 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.346834 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.346907 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.346990 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.347232 (+ 242us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.347274 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":73,"threads_started":1}
I20260620 22:07:33.347349 19247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.343052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:33817 (local address 127.0.0.1:46868)
0620 22:07:33.343315 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.343339 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:33.343417 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:33.343651 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:33.343653 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:33.343656 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:33.343751 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.343752 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.344784 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.344785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.346031 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.346033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.347027 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.347029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.347114 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.347126 (+ 12us) client_negotiation.cc:769] Sending connection context
0620 22:07:33.347200 (+ 74us) client_negotiation.cc:240] Negotiation successful
0620 22:07:33.347263 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":30,"thread_start_us":69,"threads_started":1}
I20260620 22:07:33.347361 19248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.343010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33313 (local address 127.0.0.1:59350)
0620 22:07:33.343308 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.343339 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:33.343394 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:33.343651 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:33.343653 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:33.343654 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:33.343720 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.343722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.344948 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.344949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.346031 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.346033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.347029 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.347029 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.347114 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.347126 (+ 12us) client_negotiation.cc:769] Sending connection context
0620 22:07:33.347201 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 22:07:33.347263 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":39,"thread_start_us":84,"threads_started":1}
I20260620 22:07:33.347744 19250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.343150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46868 (local address 127.1.55.194:33817)
0620 22:07:33.343291 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.343295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.343394 (+ 99us) server_negotiation.cc:407] Connection header received
0620 22:07:33.343497 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.343499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.343514 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.343563 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:33.343825 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.344708 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.346117 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.346834 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.346907 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.346990 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.347602 (+ 612us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.347644 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
I20260620 22:07:33.347877 19251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.343218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:41083 (local address 127.0.0.1:49554)
0620 22:07:33.343356 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.343365 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:33.343413 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:33.343663 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:33.343664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:33.343666 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:33.343740 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.343742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.346130 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.346130 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.346817 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.346818 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.347608 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.347609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.347672 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.347688 (+ 16us) client_negotiation.cc:769] Sending connection context
0620 22:07:33.347737 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:07:33.347781 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":1,"thread_start_us":51,"threads_started":1}
I20260620 22:07:33.347877 19252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.343273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.1.55.195:41083)
0620 22:07:33.343466 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.343469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.343476 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:07:33.343501 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.343502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.343513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.343616 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:33.343809 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.344863 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.346904 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.347523 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.347606 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.347689 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.347745 (+ 56us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.347793 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":54,"threads_started":1}
I20260620 22:07:33.348376 19042 tablet_service.cc:1467] Processing CreateTablet for tablet ab4844822b234e7887e7440e05326bf5 (DEFAULT_TABLE table=test-table [id=44c01166503545649ab86eb3b4563ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:33.348534 19173 tablet_service.cc:1467] Processing CreateTablet for tablet ab4844822b234e7887e7440e05326bf5 (DEFAULT_TABLE table=test-table [id=44c01166503545649ab86eb3b4563ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:33.348719 19042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab4844822b234e7887e7440e05326bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:33.348789 19173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab4844822b234e7887e7440e05326bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:33.350031 18911 tablet_service.cc:1467] Processing CreateTablet for tablet ab4844822b234e7887e7440e05326bf5 (DEFAULT_TABLE table=test-table [id=44c01166503545649ab86eb3b4563ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:33.350301 18911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab4844822b234e7887e7440e05326bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:33.351801 19254 tablet_bootstrap.cc:492] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: Bootstrap starting.
I20260620 22:07:33.352421 19254 tablet_bootstrap.cc:654] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:33.352725 19254 log.cc:824] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:33.352865 19255 tablet_bootstrap.cc:492] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1: Bootstrap starting.
I20260620 22:07:33.353047 19253 tablet_bootstrap.cc:492] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: Bootstrap starting.
I20260620 22:07:33.353461 19254 tablet_bootstrap.cc:492] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: No bootstrap required, opened a new log
I20260620 22:07:33.353507 19255 tablet_bootstrap.cc:654] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:33.353555 19254 ts_tablet_manager.cc:1397] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:33.353588 19253 tablet_bootstrap.cc:654] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:33.353796 19255 log.cc:824] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:33.353861 19253 log.cc:824] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:33.354507 19255 tablet_bootstrap.cc:492] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1: No bootstrap required, opened a new log
I20260620 22:07:33.354558 19253 tablet_bootstrap.cc:492] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: No bootstrap required, opened a new log
I20260620 22:07:33.354571 19255 ts_tablet_manager.cc:1397] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:07:33.354607 19253 ts_tablet_manager.cc:1397] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 22:07:33.355542 19254 raft_consensus.cc:348] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.355647 19254 raft_consensus.cc:374] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:33.355666 19254 raft_consensus.cc:729] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37af5f3f483a45afbf99645bc7ae0352, State: Initialized, Role: FOLLOWER
I20260620 22:07:33.355780 19254 consensus_queue.cc:260] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.356040 19239 heartbeater.cc:503] Master 127.1.55.254:33059 was elected leader, sending a full tablet report...
I20260620 22:07:33.356025 19254 ts_tablet_manager.cc:1428] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:07:33.357069 19255 raft_consensus.cc:348] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.357069 19253 raft_consensus.cc:348] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.357215 19255 raft_consensus.cc:374] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:33.357216 19253 raft_consensus.cc:374] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:33.357247 19255 raft_consensus.cc:729] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2759c024f9af4aaca5d4c6aee678dcc1, State: Initialized, Role: FOLLOWER
I20260620 22:07:33.357247 19253 raft_consensus.cc:729] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab51c255946408bb382af9966c3b8c2, State: Initialized, Role: FOLLOWER
I20260620 22:07:33.357352 19255 consensus_queue.cc:260] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.357357 19253 consensus_queue.cc:260] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.357605 19253 ts_tablet_manager.cc:1428] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 22:07:33.357616 19255 ts_tablet_manager.cc:1428] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 22:07:33.357674 18977 heartbeater.cc:503] Master 127.1.55.254:33059 was elected leader, sending a full tablet report...
I20260620 22:07:33.357733 19108 heartbeater.cc:503] Master 127.1.55.254:33059 was elected leader, sending a full tablet report...
I20260620 22:07:33.385707 19261 raft_consensus.cc:482] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:33.385773 19261 raft_consensus.cc:504] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.386147 19261 leader_election.cc:288] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37af5f3f483a45afbf99645bc7ae0352 (127.1.55.195:41083), bab51c255946408bb382af9966c3b8c2 (127.1.55.194:33817)
I20260620 22:07:33.388676 19252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.386340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:56199 (local address 127.1.55.195:41083)
0620 22:07:33.386372 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.386374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.386382 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:07:33.386447 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.386448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.386459 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.386535 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:33.386683 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.387140 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.388012 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.388353 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.388431 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.388438 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.388588 (+ 150us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.388621 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:07:33.388676 18979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.386265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:41083 (local address 127.1.55.193:56199)
0620 22:07:33.386317 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.386327 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:33.386367 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:33.386553 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:33.386554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:33.386556 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:33.386614 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.386616 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.387222 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.387223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.387922 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.387924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.388442 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.388443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.388508 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.388511 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:33.388570 (+ 59us) client_negotiation.cc:240] Negotiation successful
0620 22:07:33.388611 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":17}
I20260620 22:07:33.388846 19250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.386365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:33909 (local address 127.1.55.194:33817)
0620 22:07:33.386407 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.386409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.386505 (+ 96us) server_negotiation.cc:407] Connection header received
0620 22:07:33.386558 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.386558 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.386569 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.386642 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:33.386794 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.387215 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.388116 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.388483 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.388564 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.388570 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.388743 (+ 173us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.388788 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:07:33.388839 19262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.386296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:33817 (local address 127.1.55.193:33909)
0620 22:07:33.386450 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.386459 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:33.386508 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:33.386651 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:33.386652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:33.386653 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:33.386714 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.386715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.387299 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.387300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.388020 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:33.388022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.388577 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.388579 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:33.388661 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.388664 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:33.388724 (+ 60us) client_negotiation.cc:240] Negotiation successful
0620 22:07:33.388760 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
I20260620 22:07:33.389086 19193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab4844822b234e7887e7440e05326bf5" candidate_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37af5f3f483a45afbf99645bc7ae0352" is_pre_election: true
I20260620 22:07:33.389230 19193 raft_consensus.cc:2454] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2759c024f9af4aaca5d4c6aee678dcc1 in term 0.
I20260620 22:07:33.389246 19062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab4844822b234e7887e7440e05326bf5" candidate_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab51c255946408bb382af9966c3b8c2" is_pre_election: true
I20260620 22:07:33.389392 19062 raft_consensus.cc:2454] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2759c024f9af4aaca5d4c6aee678dcc1 in term 0.
I20260620 22:07:33.389478 18864 leader_election.cc:302] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2759c024f9af4aaca5d4c6aee678dcc1, 37af5f3f483a45afbf99645bc7ae0352; no voters:
I20260620 22:07:33.389667 19261 raft_consensus.cc:2781] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:07:33.389717 19261 raft_consensus.cc:482] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:07:33.389743 19261 raft_consensus.cc:3037] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:33.390360 19261 raft_consensus.cc:504] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.390486 19261 leader_election.cc:288] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [CANDIDATE]: Term 1 election: Requested vote from peers 37af5f3f483a45afbf99645bc7ae0352 (127.1.55.195:41083), bab51c255946408bb382af9966c3b8c2 (127.1.55.194:33817)
I20260620 22:07:33.390614 19062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab4844822b234e7887e7440e05326bf5" candidate_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bab51c255946408bb382af9966c3b8c2"
I20260620 22:07:33.390630 19193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab4844822b234e7887e7440e05326bf5" candidate_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37af5f3f483a45afbf99645bc7ae0352"
I20260620 22:07:33.390681 19193 raft_consensus.cc:3037] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:33.390681 19062 raft_consensus.cc:3037] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:33.391477 19193 raft_consensus.cc:2454] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2759c024f9af4aaca5d4c6aee678dcc1 in term 1.
I20260620 22:07:33.391477 19062 raft_consensus.cc:2454] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2759c024f9af4aaca5d4c6aee678dcc1 in term 1.
I20260620 22:07:33.391624 18865 leader_election.cc:302] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2759c024f9af4aaca5d4c6aee678dcc1, bab51c255946408bb382af9966c3b8c2; no voters:
I20260620 22:07:33.391719 19261 raft_consensus.cc:2781] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:33.391883 19261 raft_consensus.cc:686] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 1 LEADER]: Becoming Leader. State: Replica: 2759c024f9af4aaca5d4c6aee678dcc1, State: Running, Role: LEADER
I20260620 22:07:33.391980 19261 consensus_queue.cc:237] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } }
I20260620 22:07:33.392675 18788 catalog_manager.cc:5495] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2759c024f9af4aaca5d4c6aee678dcc1 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2759c024f9af4aaca5d4c6aee678dcc1" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33313 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 } health_report { overall_health: UNKNOWN } } }
I20260620 22:07:33.407377 19249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.404960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59358 (local address 127.1.55.193:33313)
0620 22:07:33.405016 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:33.405018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:33.405025 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:07:33.405105 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:33.405106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:33.405129 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:33.405194 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:07:33.405302 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.405789 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.406593 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:33.406780 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:33.406849 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:33.407037 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:07:33.407134 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:07:33.407209 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:33.407252 (+ 43us) server_negotiation.cc:299] Negotiation successful
0620 22:07:33.407267 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260620 22:07:33.408777 19062 raft_consensus.cc:1261] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 1 FOLLOWER]: Refusing update from remote peer 2759c024f9af4aaca5d4c6aee678dcc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:33.408777 19193 raft_consensus.cc:1261] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 1 FOLLOWER]: Refusing update from remote peer 2759c024f9af4aaca5d4c6aee678dcc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:33.409147 19263 consensus_queue.cc:1035] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37af5f3f483a45afbf99645bc7ae0352" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:33.409272 19261 consensus_queue.cc:1035] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bab51c255946408bb382af9966c3b8c2" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:33.411378 19268 mvcc.cc:205] Tried to move back new op lower bound from 7299044365960179712 to 7299044365894123520. Current Snapshot: MvccSnapshot[applied={T|T < 7299044365960179712}]
I20260620 22:07:33.413416 18787 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:33.413522 18787 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:33.414196 18787 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdc92e63411d4e739900ad0d04cb7aeb: Sending DeleteTablet for 3 replicas of tablet ab4844822b234e7887e7440e05326bf5
I20260620 22:07:33.414470 18911 tablet_service.cc:1514] Processing DeleteTablet for tablet ab4844822b234e7887e7440e05326bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:33 UTC) from {username='slave'} at 127.0.0.1:59350
I20260620 22:07:33.414515 19173 tablet_service.cc:1514] Processing DeleteTablet for tablet ab4844822b234e7887e7440e05326bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:33 UTC) from {username='slave'} at 127.0.0.1:49554
I20260620 22:07:33.414680 19275 tablet_replica.cc:330] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1: stopping tablet replica
I20260620 22:07:33.414718 19042 tablet_service.cc:1514] Processing DeleteTablet for tablet ab4844822b234e7887e7440e05326bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:33 UTC) from {username='slave'} at 127.0.0.1:46868
I20260620 22:07:33.414798 19275 raft_consensus.cc:2229] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:07:33.414896 19275 raft_consensus.cc:2258] T ab4844822b234e7887e7440e05326bf5 P 2759c024f9af4aaca5d4c6aee678dcc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:33.414902 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 18849
I20260620 22:07:33.415385 19276 tablet_replica.cc:330] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: stopping tablet replica
I20260620 22:07:33.415469 19276 raft_consensus.cc:2229] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:33.415562 19276 raft_consensus.cc:2258] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:33.416996 19276 ts_tablet_manager.cc:1905] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:33.418432 19277 tablet_replica.cc:330] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: stopping tablet replica
I20260620 22:07:33.418524 19277 raft_consensus.cc:2229] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:33.418617 19277 raft_consensus.cc:2258] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:33.418709 19276 ts_tablet_manager.cc:1918] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:33.418817 19276 log.cc:1196] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/ab4844822b234e7887e7440e05326bf5
I20260620 22:07:33.419092 19276 ts_tablet_manager.cc:1939] T ab4844822b234e7887e7440e05326bf5 P 37af5f3f483a45afbf99645bc7ae0352: Deleting consensus metadata
I20260620 22:07:33.419325 19277 ts_tablet_manager.cc:1905] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:33.419478 18773 catalog_manager.cc:4841] TS 37af5f3f483a45afbf99645bc7ae0352 (127.1.55.195:41083): tablet ab4844822b234e7887e7440e05326bf5 (table test-table [id=44c01166503545649ab86eb3b4563ccf]) successfully deleted
I20260620 22:07:33.420675 19277 ts_tablet_manager.cc:1918] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:33.420753 19277 log.cc:1196] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/ab4844822b234e7887e7440e05326bf5
I20260620 22:07:33.420970 19277 ts_tablet_manager.cc:1939] T ab4844822b234e7887e7440e05326bf5 P bab51c255946408bb382af9966c3b8c2: Deleting consensus metadata
W20260620 22:07:33.421286 18773 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:33313 (error 108)
I20260620 22:07:33.421343 18774 catalog_manager.cc:4841] TS bab51c255946408bb382af9966c3b8c2 (127.1.55.194:33817): tablet ab4844822b234e7887e7440e05326bf5 (table test-table [id=44c01166503545649ab86eb3b4563ccf]) successfully deleted
I20260620 22:07:33.421725 19251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:33.421610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33313 (local address 127.0.0.1:59364)
0620 22:07:33.421659 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:33.421693 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260620 22:07:33.421792 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 18980
W20260620 22:07:33.421833 18773 catalog_manager.cc:4584] TS 2759c024f9af4aaca5d4c6aee678dcc1 (127.1.55.193:33313): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ab4844822b234e7887e7440e05326bf5: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33313: connect: Connection refused (error 111)
I20260620 22:07:33.426127 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 19111
I20260620 22:07:33.430663 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 18758
2026-06-20T22:07:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (639 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:33 dist-test-slave-xw35 krb5kdc[19281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:33 dist-test-slave-xw35 krb5kdc[19281](info): set up 2 sockets
Jun 20 22:07:33 dist-test-slave-xw35 krb5kdc[19281](info): commencing operation
krb5kdc: starting...
W20260620 22:07:34.393029 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.944s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:34 dist-test-slave-xw35 krb5kdc[19281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:07:34.510007 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:39037
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:39037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:34.581988 19294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:34.582166 19294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:34.582195 19294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:34.583181 19294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:34.583237 19294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:34.583257 19294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:34.583274 19294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:34.583298 19294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:34.584688 19294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:39037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:39037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:34.584947 19294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:34.585150 19294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:34.589564 19299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:34.589605 19302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:34.589569 19300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:34.589815 19294 server_base.cc:1034] running on GCE node
I20260620 22:07:34.590000 19294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:34.590251 19294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:34.591424 19294 hybrid_clock.cc:648] HybridClock initialized: now 1781993254591423 us; error 40 us; skew 500 ppm
Jun 20 22:07:34 dist-test-slave-xw35 krb5kdc[19281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993254, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:34.593448 19294 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:34.593909 19294 webserver.cc:460] Webserver started at http://127.1.55.254:35549/ using document root <none> and password file <none>
I20260620 22:07:34.594101 19294 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:34.594161 19294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:34.594281 19294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:34.595146 19294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "eae4fffe081347bb9fc026ec820e0aad"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "6ea478769be55135f1fe8f3d31eca378"
server_key_iv: "3bac9a160e1fbce1e52decbbd8954de2"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.595464 19294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "eae4fffe081347bb9fc026ec820e0aad"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "6ea478769be55135f1fe8f3d31eca378"
server_key_iv: "3bac9a160e1fbce1e52decbbd8954de2"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.596653 19294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:34.597342 19309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:34.597512 19294 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:34.597608 19294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "eae4fffe081347bb9fc026ec820e0aad"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "6ea478769be55135f1fe8f3d31eca378"
server_key_iv: "3bac9a160e1fbce1e52decbbd8954de2"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.597685 19294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:34.617511 19294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:34.619098 19294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:34.619246 19294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:34.622996 19294 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:39037
I20260620 22:07:34.623027 19361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:39037 every 8 connection(s)
I20260620 22:07:34.623325 19294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:34.623932 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 19294
I20260620 22:07:34.624053 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:34.624220 19362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:34.624261 1247 external_mini_cluster.cc:1428] Setting key 448e525cb1cf7b1fdbd4a5171bc68952
I20260620 22:07:34.626674 19362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad: Bootstrap starting.
I20260620 22:07:34.627236 19362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:34.627521 19362 log.cc:824] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:34.628153 19362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad: No bootstrap required, opened a new log
I20260620 22:07:34.630214 19362 raft_consensus.cc:348] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae4fffe081347bb9fc026ec820e0aad" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39037 } }
I20260620 22:07:34.630381 19362 raft_consensus.cc:374] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:34.630415 19362 raft_consensus.cc:729] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae4fffe081347bb9fc026ec820e0aad, State: Initialized, Role: FOLLOWER
Jun 20 22:07:34 dist-test-slave-xw35 krb5kdc[19281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:34.630558 19362 consensus_queue.cc:260] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae4fffe081347bb9fc026ec820e0aad" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39037 } }
I20260620 22:07:34.630656 19362 raft_consensus.cc:388] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:34.630697 19362 raft_consensus.cc:482] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:34.630767 19362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:34.631281 19362 raft_consensus.cc:504] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae4fffe081347bb9fc026ec820e0aad" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39037 } }
I20260620 22:07:34.631408 19362 leader_election.cc:302] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eae4fffe081347bb9fc026ec820e0aad; no voters:
I20260620 22:07:34.631605 19362 leader_election.cc:288] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:34.631662 19367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:34.631845 19362 sys_catalog.cc:564] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:34.631834 19367 raft_consensus.cc:686] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [term 1 LEADER]: Becoming Leader. State: Replica: eae4fffe081347bb9fc026ec820e0aad, State: Running, Role: LEADER
I20260620 22:07:34.632014 19367 consensus_queue.cc:237] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae4fffe081347bb9fc026ec820e0aad" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39037 } }
I20260620 22:07:34.632344 19368 sys_catalog.cc:455] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eae4fffe081347bb9fc026ec820e0aad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae4fffe081347bb9fc026ec820e0aad" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39037 } } }
I20260620 22:07:34.632483 19368 sys_catalog.cc:458] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:34.632719 19376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:34.633220 19376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:34.633510 19369 sys_catalog.cc:455] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [sys.catalog]: SysCatalogTable state changed. Reason: New leader eae4fffe081347bb9fc026ec820e0aad. Latest consensus state: current_term: 1 leader_uuid: "eae4fffe081347bb9fc026ec820e0aad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae4fffe081347bb9fc026ec820e0aad" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39037 } } }
I20260620 22:07:34.633611 19369 sys_catalog.cc:458] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:34.634717 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:34.624731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33014 (local address 127.1.55.254:39037)
0620 22:07:34.624909 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:34.624918 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:34.624950 (+ 32us) server_negotiation.cc:407] Connection header received
0620 22:07:34.625394 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:34.625400 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:34.625442 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:34.625598 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:34.626221 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.627137 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.628021 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.628459 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.628602 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:34.631014 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:34.631017 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:34.631018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:34.631029 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:34.633076 (+ 2047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:34.633504 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:34.633506 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:34.633507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:34.633631 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:34.633855 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:34.633855 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:34.633856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:34.634117 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:34.634346 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:34.634412 (+ 66us) server_negotiation.cc:299] Negotiation successful
0620 22:07:34.634536 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
I20260620 22:07:34.634940 19376 catalog_manager.cc:1347] Generated new cluster ID: 54d340b05c354a5b90a2612c30b166d9
I20260620 22:07:34.634984 19376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:34.648554 19376 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:34.649021 19376 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:34.656646 19376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad: Generated new TSK 0
I20260620 22:07:34.656816 19376 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:07:34.683688 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39037
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:34.758359 19388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:34.758561 19388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:34.758596 19388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:34.759712 19388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:34.759769 19388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:34.759821 19388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:07:34.761117 19388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:34.761360 19388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:34.761579 19388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:34.765789 19394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:34.765786 19393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:34.765785 19396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:34.766132 19388 server_base.cc:1034] running on GCE node
I20260620 22:07:34.766351 19388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:34.766605 19388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:34.767743 19388 hybrid_clock.cc:648] HybridClock initialized: now 1781993254767725 us; error 33 us; skew 500 ppm
Jun 20 22:07:34 dist-test-slave-xw35 krb5kdc[19281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993254, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:34.770066 19388 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:07:34.770503 19388 webserver.cc:460] Webserver started at http://127.1.55.193:37493/ using document root <none> and password file <none>
I20260620 22:07:34.770704 19388 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:34.770762 19388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:34.770898 19388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:34.771855 19388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "e5085923367e47e1854b1831d8634851"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "d54099e4a5a6f5b4fd34008e651e700c"
server_key_iv: "b2743e79cd13b38bb5bab995a6687b47"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.772195 19388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "e5085923367e47e1854b1831d8634851"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "d54099e4a5a6f5b4fd34008e651e700c"
server_key_iv: "b2743e79cd13b38bb5bab995a6687b47"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.773583 19388 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:07:34.774291 19403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:34.774449 19388 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:34.774567 19388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "e5085923367e47e1854b1831d8634851"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "d54099e4a5a6f5b4fd34008e651e700c"
server_key_iv: "b2743e79cd13b38bb5bab995a6687b47"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.774652 19388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:34.785694 19388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:34.787338 19388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:34.787472 19388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:34.787657 19388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:34.787964 19388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:34.788018 19388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:34.788056 19388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:34.788085 19388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:34.793287 19388 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:33107
I20260620 22:07:34.793318 19516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:33107 every 8 connection(s)
I20260620 22:07:34.793602 19388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:07:34.797462 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 19388
I20260620 22:07:34.797610 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:07:34.797798 1247 external_mini_cluster.cc:1428] Setting key ff6ab3ce8f8cdf9ed71e2aa44f345a26
Jun 20 22:07:34 dist-test-slave-xw35 krb5kdc[19281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993254, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:34.802317 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:34.794222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:54137 (local address 127.1.55.254:39037)
0620 22:07:34.794290 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:34.794292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:34.794488 (+ 196us) server_negotiation.cc:407] Connection header received
0620 22:07:34.794934 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:34.794935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:34.794946 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:34.795006 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:34.795787 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.796319 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.797269 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.797515 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.797582 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:34.799665 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:34.799667 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:34.799667 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:34.799674 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:34.801051 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:34.801442 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:34.801443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:34.801444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:34.801515 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:34.801744 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:34.801745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:34.801745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:34.801853 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:34.801921 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:34.802160 (+ 239us) server_negotiation.cc:299] Negotiation successful
0620 22:07:34.802237 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260620 22:07:34.802490 19519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:34.794226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:39037 (local address 127.1.55.193:54137)
0620 22:07:34.794379 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:34.794408 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:34.794839 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:34.795068 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:34.795071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:34.795539 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:34.795692 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:34.795696 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.796411 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.796412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:34.797180 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:34.797182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.797616 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.797617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:34.797717 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:34.798203 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:34.798210 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:34.799567 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:34.801143 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:34.801150 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:34.801151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:34.801372 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:34.801576 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:34.801576 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:34.801577 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:34.801672 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:34.801914 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:34.801919 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:34.802042 (+ 123us) client_negotiation.cc:769] Sending connection context
0620 22:07:34.802137 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 22:07:34.802270 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260620 22:07:34.802909 19517 heartbeater.cc:347] Connected to a master server at 127.1.55.254:39037
I20260620 22:07:34.803002 19517 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:34.803211 19517 heartbeater.cc:511] Master 127.1.55.254:39037 requested a full tablet report, sending...
I20260620 22:07:34.803706 19326 ts_manager.cc:194] Registered new tserver with Master: e5085923367e47e1854b1831d8634851 (127.1.55.193:33107)
I20260620 22:07:34.804286 19326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:54137
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:07:34.819828 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39037
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:34.895565 19522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:34.895731 19522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:34.895753 19522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:34.896802 19522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:34.896836 19522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:34.896862 19522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:07:34.898262 19522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:34.898422 19522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:34.898572 19522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:34.903306 19530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:34.903334 19528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:34.903307 19527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:34.903764 19522 server_base.cc:1034] running on GCE node
I20260620 22:07:34.903930 19522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:34.904094 19522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:34.905221 19522 hybrid_clock.cc:648] HybridClock initialized: now 1781993254905201 us; error 35 us; skew 500 ppm
Jun 20 22:07:34 dist-test-slave-xw35 krb5kdc[19281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993254, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:34.907560 19522 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:07:34.907984 19522 webserver.cc:460] Webserver started at http://127.1.55.194:39019/ using document root <none> and password file <none>
I20260620 22:07:34.908190 19522 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:34.908231 19522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:34.908401 19522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:34.909387 19522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "9f9f8ea09ea648e796a177920e426b12"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "4703d19f621eab9905dcf242c22951be"
server_key_iv: "387f40ede440496337a9b2a5e657150b"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.909776 19522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "9f9f8ea09ea648e796a177920e426b12"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "4703d19f621eab9905dcf242c22951be"
server_key_iv: "387f40ede440496337a9b2a5e657150b"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.910955 19522 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:34.911586 19537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:34.911747 19522 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:34.911835 19522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "9f9f8ea09ea648e796a177920e426b12"
format_stamp: "Formatted at 2026-06-20 22:07:34 on dist-test-slave-xw35"
server_key: "4703d19f621eab9905dcf242c22951be"
server_key_iv: "387f40ede440496337a9b2a5e657150b"
server_key_version: "encryptionkey@0"
I20260620 22:07:34.911906 19522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:34.924496 19522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:34.926134 19522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:34.926296 19522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:34.926513 19522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:34.926791 19522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:34.926851 19522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:34.926883 19522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:34.926910 19522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:34.932376 19522 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:40165
I20260620 22:07:34.932415 19650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:40165 every 8 connection(s)
I20260620 22:07:34.932777 19522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:07:34.933658 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 19522
I20260620 22:07:34.933769 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:07:34.934026 1247 external_mini_cluster.cc:1428] Setting key 6d29fbb5483481b32ff6d868e8037b94
Jun 20 22:07:34 dist-test-slave-xw35 krb5kdc[19281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993254, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:34.942032 19653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:34.933398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:39037 (local address 127.1.55.194:38433)
0620 22:07:34.933621 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:34.933664 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:34.934264 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:34.934514 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:34.934516 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:34.935193 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:34.935443 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:34.935447 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.936122 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.936123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:34.936894 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:34.936896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.937386 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.937387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:34.937468 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:34.937943 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:34.937953 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:34.939201 (+ 1248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:34.940878 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:34.940883 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:34.940885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:34.941058 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:34.941270 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:34.941271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:34.941271 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:34.941351 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:34.941627 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:34.941631 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:34.941721 (+ 90us) client_negotiation.cc:769] Sending connection context
0620 22:07:34.941808 (+ 87us) client_negotiation.cc:240] Negotiation successful
0620 22:07:34.941906 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":105,"threads_started":1}
I20260620 22:07:34.942025 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:34.933496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:38433 (local address 127.1.55.254:39037)
0620 22:07:34.933547 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:34.933549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:34.933760 (+ 211us) server_negotiation.cc:407] Connection header received
0620 22:07:34.934381 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:34.934383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:34.934393 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:34.934450 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:34.935522 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.936018 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.936978 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:34.937306 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:34.937390 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:34.939288 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:34.939289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:34.939290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:34.939298 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:34.940803 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:34.941143 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:34.941144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:34.941145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:34.941206 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:34.941421 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:34.941421 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:34.941422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:34.941567 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:34.941635 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:34.941845 (+ 210us) server_negotiation.cc:299] Negotiation successful
0620 22:07:34.941923 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:07:34.942515 19651 heartbeater.cc:347] Connected to a master server at 127.1.55.254:39037
I20260620 22:07:34.942606 19651 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:34.942762 19651 heartbeater.cc:511] Master 127.1.55.254:39037 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
I20260620 22:07:34.943100 19326 ts_manager.cc:194] Registered new tserver with Master: 9f9f8ea09ea648e796a177920e426b12 (127.1.55.194:40165)
I20260620 22:07:34.943495 19326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:38433
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:07:34.957770 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39037
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:35.031071 19656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:35.031245 19656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:35.031266 19656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:35.032416 19656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:35.032455 19656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:35.032480 19656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:07:35.034019 19656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:39037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:35.034178 19656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:35.034332 19656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:35.038928 19664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:35.039145 19656 server_base.cc:1034] running on GCE node
W20260620 22:07:35.039031 19662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:35.038928 19661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:35.039453 19656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:35.039706 19656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:35.040866 19656 hybrid_clock.cc:648] HybridClock initialized: now 1781993255040861 us; error 44 us; skew 500 ppm
Jun 20 22:07:35 dist-test-slave-xw35 krb5kdc[19281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993255, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:35.043136 19656 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:07:35.043571 19656 webserver.cc:460] Webserver started at http://127.1.55.195:40211/ using document root <none> and password file <none>
I20260620 22:07:35.043781 19656 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:35.043839 19656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:35.043991 19656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:35.044926 19656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "f7d431326b554a7a89c9654f56391868"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "8d1501997ea1b708424db046086df86f"
server_key_iv: "d614e416f761b2f5c09d65805dd9aa5b"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.045256 19656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "f7d431326b554a7a89c9654f56391868"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "8d1501997ea1b708424db046086df86f"
server_key_iv: "d614e416f761b2f5c09d65805dd9aa5b"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.046550 19656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:35.047238 19671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.047403 19656 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:35.047487 19656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "f7d431326b554a7a89c9654f56391868"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "8d1501997ea1b708424db046086df86f"
server_key_iv: "d614e416f761b2f5c09d65805dd9aa5b"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.047581 19656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:35.061607 19656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:35.063503 19656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:35.063656 19656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:35.063863 19656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:35.064141 19656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:35.064193 19656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.064232 19656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:35.064265 19656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.070058 19656 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:45569
I20260620 22:07:35.070103 19784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:45569 every 8 connection(s)
I20260620 22:07:35.070360 19656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:07:35.071233 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 19656
I20260620 22:07:35.071357 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:07:35.071529 1247 external_mini_cluster.cc:1428] Setting key a73f2bb3548b9d2268679a6c2247d245
Jun 20 22:07:35 dist-test-slave-xw35 krb5kdc[19281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993255, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:35.078935 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.070957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:44803 (local address 127.1.55.254:39037)
0620 22:07:35.071000 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.071002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.071206 (+ 204us) server_negotiation.cc:407] Connection header received
0620 22:07:35.071882 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.071883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.071895 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.071973 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:35.072896 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.073373 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.074413 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.074580 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.074631 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.076562 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:35.076563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:35.076563 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:35.076568 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:35.077820 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:35.078149 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:35.078150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:35.078150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:35.078194 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:35.078443 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:35.078443 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:35.078443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:35.078536 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:35.078588 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.078814 (+ 226us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.078877 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:07:35.079070 19787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.070922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:39037 (local address 127.1.55.195:44803)
0620 22:07:35.071074 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.071118 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.071756 (+ 638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.072024 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.072028 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.072646 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:35.072818 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.072822 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.073522 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.073524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.074323 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.074326 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.074652 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.074652 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.074742 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.075234 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:35.075241 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:35.076486 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:35.077884 (+ 1398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:35.077890 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:35.077891 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:35.078085 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:35.078249 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:35.078250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:35.078250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:35.078386 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:35.078594 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:35.078598 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:35.078691 (+ 93us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.078786 (+ 95us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.078889 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260620 22:07:35.079566 19785 heartbeater.cc:347] Connected to a master server at 127.1.55.254:39037
I20260620 22:07:35.079667 19785 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:35.079831 19785 heartbeater.cc:511] Master 127.1.55.254:39037 requested a full tablet report, sending...
I20260620 22:07:35.080266 19326 ts_manager.cc:194] Registered new tserver with Master: f7d431326b554a7a89c9654f56391868 (127.1.55.195:45569)
I20260620 22:07:35.080626 19326 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:44803
I20260620 22:07:35.083016 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:07:35.089861 19365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.084272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33028 (local address 127.1.55.254:39037)
0620 22:07:35.084307 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.084308 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.084456 (+ 148us) server_negotiation.cc:407] Connection header received
0620 22:07:35.084474 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.084475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.084482 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.084517 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:35.085028 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.085440 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.086189 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.086358 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.086404 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.087478 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:35.087479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:35.087479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:35.087485 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:35.088811 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:35.089149 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:35.089149 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:35.089150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:35.089206 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:35.089375 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:35.089376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:35.089376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:35.089514 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:35.089595 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.089687 (+ 92us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.089746 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:07:35.091189 19326 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:07:35.092520 19326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:07:35.098233 19793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.094317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:45569 (local address 127.0.0.1:43718)
0620 22:07:35.094471 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.094499 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.094555 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.094762 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.094766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.094768 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.094863 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.094865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.095890 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.095891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.096978 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.096981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.097918 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.097919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.098011 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.098022 (+ 11us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.098111 (+ 89us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.098160 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
I20260620 22:07:35.098239 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.094400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43718 (local address 127.1.55.195:45569)
0620 22:07:35.094536 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.094540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.094553 (+ 13us) server_negotiation.cc:407] Connection header received
0620 22:07:35.094641 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.094643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.094655 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.094756 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.094949 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.095796 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.097146 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.097829 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.097913 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.097981 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.098126 (+ 145us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.098160 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":61,"threads_started":1}
I20260620 22:07:35.098627 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.094275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:40165 (local address 127.0.0.1:37274)
0620 22:07:35.094461 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.094495 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.094553 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.094990 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.094991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.094993 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.095037 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.095038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.096358 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.096359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.097453 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.097455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.098402 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.098404 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.098467 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.098470 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.098500 (+ 30us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.098540 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":30,"thread_start_us":66,"threads_started":1}
I20260620 22:07:35.098793 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.094919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36294 (local address 127.1.55.193:33107)
0620 22:07:35.095104 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.095108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.095117 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:07:35.095153 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.095155 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.095168 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.095241 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.095425 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.096444 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.097649 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.098360 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.098421 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.098475 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.098668 (+ 193us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.098717 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":81,"threads_started":1}
I20260620 22:07:35.098722 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.094468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33107 (local address 127.0.0.1:36294)
0620 22:07:35.094919 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.094928 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.094970 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.095326 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.095327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.095328 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.095364 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.095365 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.096543 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.096544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.097573 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.097575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.098428 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.098429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.098487 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.098491 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.098560 (+ 69us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.098598 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":67,"threads_started":1}
I20260620 22:07:35.099138 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.094612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37274 (local address 127.1.55.194:40165)
0620 22:07:35.094804 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.094808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.094820 (+ 12us) server_negotiation.cc:407] Connection header received
0620 22:07:35.094866 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.094868 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.094884 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.095104 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.095184 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.096252 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.097555 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.098273 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.098987 (+ 714us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.099033 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.099052 (+ 19us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.099082 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":108,"threads_started":1}
I20260620 22:07:35.099145 19719 tablet_service.cc:1467] Processing CreateTablet for tablet ab50f198157d4ad6bbb3b720ae5bafb7 (DEFAULT_TABLE table=test-table [id=1492bb5690f54432bce9efdb4695ede4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:35.099462 19719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab50f198157d4ad6bbb3b720ae5bafb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:35.099852 19585 tablet_service.cc:1467] Processing CreateTablet for tablet ab50f198157d4ad6bbb3b720ae5bafb7 (DEFAULT_TABLE table=test-table [id=1492bb5690f54432bce9efdb4695ede4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:35.100203 19585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab50f198157d4ad6bbb3b720ae5bafb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:35.101895 19451 tablet_service.cc:1467] Processing CreateTablet for tablet ab50f198157d4ad6bbb3b720ae5bafb7 (DEFAULT_TABLE table=test-table [id=1492bb5690f54432bce9efdb4695ede4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:35.101991 19799 tablet_bootstrap.cc:492] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: Bootstrap starting.
I20260620 22:07:35.102203 19451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab50f198157d4ad6bbb3b720ae5bafb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:35.102658 19799 tablet_bootstrap.cc:654] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:35.102860 19800 tablet_bootstrap.cc:492] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Bootstrap starting.
I20260620 22:07:35.103173 19799 log.cc:824] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:35.103443 19800 tablet_bootstrap.cc:654] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:35.103761 19799 tablet_bootstrap.cc:492] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: No bootstrap required, opened a new log
I20260620 22:07:35.103802 19799 ts_tablet_manager.cc:1397] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:35.103955 19800 log.cc:824] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:35.104667 19800 tablet_bootstrap.cc:492] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: No bootstrap required, opened a new log
I20260620 22:07:35.104720 19800 ts_tablet_manager.cc:1397] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:35.105106 19799 raft_consensus.cc:348] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.105247 19799 raft_consensus.cc:374] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:35.105280 19799 raft_consensus.cc:729] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d431326b554a7a89c9654f56391868, State: Initialized, Role: FOLLOWER
I20260620 22:07:35.105316 19803 tablet_bootstrap.cc:492] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851: Bootstrap starting.
I20260620 22:07:35.105410 19799 consensus_queue.cc:260] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.105715 19799 ts_tablet_manager.cc:1428] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:07:35.105799 19785 heartbeater.cc:503] Master 127.1.55.254:39037 was elected leader, sending a full tablet report...
I20260620 22:07:35.105899 19803 tablet_bootstrap.cc:654] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:35.106501 19803 log.cc:824] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:35.106860 19800 raft_consensus.cc:348] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.107031 19800 raft_consensus.cc:374] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:35.107105 19800 raft_consensus.cc:729] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f9f8ea09ea648e796a177920e426b12, State: Initialized, Role: FOLLOWER
I20260620 22:07:35.107262 19800 consensus_queue.cc:260] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.107406 19803 tablet_bootstrap.cc:492] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851: No bootstrap required, opened a new log
I20260620 22:07:35.107473 19803 ts_tablet_manager.cc:1397] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:07:35.107517 19800 ts_tablet_manager.cc:1428] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:07:35.107538 19651 heartbeater.cc:503] Master 127.1.55.254:39037 was elected leader, sending a full tablet report...
I20260620 22:07:35.108945 19803 raft_consensus.cc:348] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.109053 19803 raft_consensus.cc:374] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:35.109073 19803 raft_consensus.cc:729] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5085923367e47e1854b1831d8634851, State: Initialized, Role: FOLLOWER
I20260620 22:07:35.109146 19803 consensus_queue.cc:260] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.109321 19803 ts_tablet_manager.cc:1428] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:07:35.109349 19517 heartbeater.cc:503] Master 127.1.55.254:39037 was elected leader, sending a full tablet report...
W20260620 22:07:35.183321 19652 tablet.cc:2369] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:07:35.237833 19806 raft_consensus.cc:482] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:35.237943 19806 raft_consensus.cc:504] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.238289 19806 leader_election.cc:288] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d431326b554a7a89c9654f56391868 (127.1.55.195:45569), e5085923367e47e1854b1831d8634851 (127.1.55.193:33107)
I20260620 22:07:35.239907 19804 raft_consensus.cc:482] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:35.240001 19804 raft_consensus.cc:504] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.240305 19804 leader_election.cc:288] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f9f8ea09ea648e796a177920e426b12 (127.1.55.194:40165), e5085923367e47e1854b1831d8634851 (127.1.55.193:33107)
I20260620 22:07:35.241272 19653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.238400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33107 (local address 127.1.55.194:51031)
0620 22:07:35.238450 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.238461 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.238499 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.238663 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.238664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.238666 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.238735 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.238737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.239405 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.239406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.240271 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.240273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.241033 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.241035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.241116 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.241119 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.241161 (+ 42us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.241201 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260620 22:07:35.241350 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.238582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:46461 (local address 127.1.55.195:45569)
0620 22:07:35.238634 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.238636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.238662 (+ 26us) server_negotiation.cc:407] Connection header received
0620 22:07:35.238784 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.238785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.238795 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.238844 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.238971 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.239395 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.240472 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.241007 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.241061 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.241068 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.241247 (+ 179us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.241281 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 22:07:35.241541 19808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.238489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:45569 (local address 127.1.55.194:46461)
0620 22:07:35.238613 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.238621 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.238725 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.238856 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.238857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.238858 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.238914 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.238915 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.239462 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.239463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.240350 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.240353 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.241095 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.241096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.241172 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.241177 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.241414 (+ 237us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.241449 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
I20260620 22:07:35.241827 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.238492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:51031 (local address 127.1.55.193:33107)
0620 22:07:35.238533 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.238535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.238544 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:07:35.238569 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.238570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.238580 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.238633 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.238856 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.239333 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.240375 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.240936 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.240994 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.241004 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.241688 (+ 684us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.241737 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:07:35.242038 19739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab50f198157d4ad6bbb3b720ae5bafb7" candidate_uuid: "9f9f8ea09ea648e796a177920e426b12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d431326b554a7a89c9654f56391868" is_pre_election: true
I20260620 22:07:35.242055 19471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab50f198157d4ad6bbb3b720ae5bafb7" candidate_uuid: "9f9f8ea09ea648e796a177920e426b12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5085923367e47e1854b1831d8634851" is_pre_election: true
I20260620 22:07:35.242137 19739 raft_consensus.cc:2454] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f9f8ea09ea648e796a177920e426b12 in term 0.
I20260620 22:07:35.242184 19471 raft_consensus.cc:2454] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f9f8ea09ea648e796a177920e426b12 in term 0.
I20260620 22:07:35.242314 19540 leader_election.cc:302] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f9f8ea09ea648e796a177920e426b12, f7d431326b554a7a89c9654f56391868; no voters:
I20260620 22:07:35.242416 19806 raft_consensus.cc:2781] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:07:35.242450 19806 raft_consensus.cc:482] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:07:35.242468 19806 raft_consensus.cc:3037] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:35.243283 19806 raft_consensus.cc:504] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.243413 19806 leader_election.cc:288] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [CANDIDATE]: Term 1 election: Requested vote from peers f7d431326b554a7a89c9654f56391868 (127.1.55.195:45569), e5085923367e47e1854b1831d8634851 (127.1.55.193:33107)
I20260620 22:07:35.243573 19809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.240501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33107 (local address 127.1.55.195:59327)
0620 22:07:35.240636 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.240644 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.240682 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.240876 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.240876 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.240878 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.240933 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.240934 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.241790 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.241791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.242784 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.242786 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.243296 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.243297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.243409 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.243414 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.243456 (+ 42us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.243506 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":30,"thread_start_us":83,"threads_started":1}
I20260620 22:07:35.243577 19471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab50f198157d4ad6bbb3b720ae5bafb7" candidate_uuid: "9f9f8ea09ea648e796a177920e426b12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5085923367e47e1854b1831d8634851"
I20260620 22:07:35.243659 19471 raft_consensus.cc:3037] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:35.243785 19787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.240417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:40165 (local address 127.1.55.195:56411)
0620 22:07:35.240468 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.240479 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.240511 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.241062 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.241062 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.241063 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.241120 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.241121 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.241874 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.241875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.242857 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.242859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.243563 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.243564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.243634 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.243637 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.243685 (+ 48us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.243725 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260620 22:07:35.243583 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.240647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:59327 (local address 127.1.55.193:33107)
0620 22:07:35.240757 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.240758 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.240765 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:07:35.240782 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.240783 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.240790 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.240862 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.241011 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.241703 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.242867 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.243220 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.243298 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.243304 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.243480 (+ 176us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.243525 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":66,"threads_started":1}
I20260620 22:07:35.243860 19739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab50f198157d4ad6bbb3b720ae5bafb7" candidate_uuid: "9f9f8ea09ea648e796a177920e426b12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d431326b554a7a89c9654f56391868"
I20260620 22:07:35.243923 19739 raft_consensus.cc:3037] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:35.244051 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.240915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:56411 (local address 127.1.55.194:40165)
0620 22:07:35.240954 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.240956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.240962 (+ 6us) server_negotiation.cc:407] Connection header received
0620 22:07:35.240978 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.240979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.240985 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.241027 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.241183 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.241803 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.242946 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.243450 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.243527 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.243534 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.243964 (+ 430us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.244003 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 22:07:35.244223 19605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab50f198157d4ad6bbb3b720ae5bafb7" candidate_uuid: "f7d431326b554a7a89c9654f56391868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f9f8ea09ea648e796a177920e426b12" is_pre_election: true
I20260620 22:07:35.244335 19605 raft_consensus.cc:2379] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7d431326b554a7a89c9654f56391868 in current term 1: Already voted for candidate 9f9f8ea09ea648e796a177920e426b12 in this term.
I20260620 22:07:35.244527 19471 raft_consensus.cc:2454] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f9f8ea09ea648e796a177920e426b12 in term 1.
I20260620 22:07:35.244657 19541 leader_election.cc:302] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f9f8ea09ea648e796a177920e426b12, e5085923367e47e1854b1831d8634851; no voters:
I20260620 22:07:35.244740 19806 raft_consensus.cc:2781] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:35.244695 19470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab50f198157d4ad6bbb3b720ae5bafb7" candidate_uuid: "f7d431326b554a7a89c9654f56391868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5085923367e47e1854b1831d8634851" is_pre_election: true
I20260620 22:07:35.244766 19739 raft_consensus.cc:2454] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f9f8ea09ea648e796a177920e426b12 in term 1.
I20260620 22:07:35.244797 19470 raft_consensus.cc:2379] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7d431326b554a7a89c9654f56391868 in current term 1: Already voted for candidate 9f9f8ea09ea648e796a177920e426b12 in this term.
I20260620 22:07:35.244859 19806 raft_consensus.cc:686] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 1 LEADER]: Becoming Leader. State: Replica: 9f9f8ea09ea648e796a177920e426b12, State: Running, Role: LEADER
I20260620 22:07:35.244946 19806 consensus_queue.cc:237] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } }
I20260620 22:07:35.245024 19675 leader_election.cc:302] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7d431326b554a7a89c9654f56391868; no voters: 9f9f8ea09ea648e796a177920e426b12, e5085923367e47e1854b1831d8634851
I20260620 22:07:35.245148 19804 raft_consensus.cc:2726] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 22:07:35.245647 19326 catalog_manager.cc:5495] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f9f8ea09ea648e796a177920e426b12 (127.1.55.194). New cstate: current_term: 1 leader_uuid: "9f9f8ea09ea648e796a177920e426b12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f9f8ea09ea648e796a177920e426b12" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 40165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 } health_report { overall_health: UNKNOWN } } }
I20260620 22:07:35.277020 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.275092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37276 (local address 127.1.55.194:40165)
0620 22:07:35.275137 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.275139 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.275151 (+ 12us) server_negotiation.cc:407] Connection header received
0620 22:07:35.275173 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.275173 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.275186 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.275239 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:07:35.275341 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.275690 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.276364 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.276525 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.276570 (+ 45us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.276751 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:07:35.276830 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:07:35.276907 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.276957 (+ 50us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.276964 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 22:07:35.278550 19470 raft_consensus.cc:1261] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851 [term 1 FOLLOWER]: Refusing update from remote peer 9f9f8ea09ea648e796a177920e426b12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:35.278580 19739 raft_consensus.cc:1261] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 1 FOLLOWER]: Refusing update from remote peer 9f9f8ea09ea648e796a177920e426b12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:35.278841 19811 consensus_queue.cc:1035] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5085923367e47e1854b1831d8634851" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:35.278968 19806 consensus_queue.cc:1035] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d431326b554a7a89c9654f56391868" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 45569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:35.281750 19816 mvcc.cc:205] Tried to move back new op lower bound from 7299044373618831360 to 7299044373483773952. Current Snapshot: MvccSnapshot[applied={T|T < 7299044373618831360}]
I20260620 22:07:35.282837 19325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:35.282920 19325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:35.283551 19325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eae4fffe081347bb9fc026ec820e0aad: Sending DeleteTablet for 3 replicas of tablet ab50f198157d4ad6bbb3b720ae5bafb7
I20260620 22:07:35.283902 19585 tablet_service.cc:1514] Processing DeleteTablet for tablet ab50f198157d4ad6bbb3b720ae5bafb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:35 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:37274
I20260620 22:07:35.283885 19719 tablet_service.cc:1514] Processing DeleteTablet for tablet ab50f198157d4ad6bbb3b720ae5bafb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:35 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:43718
I20260620 22:07:35.284062 19451 tablet_service.cc:1514] Processing DeleteTablet for tablet ab50f198157d4ad6bbb3b720ae5bafb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:35 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36294
I20260620 22:07:35.284289 19826 tablet_replica.cc:330] T ab50f198157d4ad6bbb3b720ae5bafb7 P e5085923367e47e1854b1831d8634851: stopping tablet replica
I20260620 22:07:35.284366 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 19388
I20260620 22:07:35.284883 19825 tablet_replica.cc:330] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: stopping tablet replica
I20260620 22:07:35.284977 19825 raft_consensus.cc:2229] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:35.285073 19825 raft_consensus.cc:2258] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:35.285202 19824 tablet_replica.cc:330] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: stopping tablet replica
I20260620 22:07:35.285279 19824 raft_consensus.cc:2229] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:07:35.285368 19824 raft_consensus.cc:2258] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:35.285780 19825 ts_tablet_manager.cc:1905] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:35.285905 19824 ts_tablet_manager.cc:1905] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:35.287534 19825 ts_tablet_manager.cc:1918] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:35.287657 19825 log.cc:1196] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/ab50f198157d4ad6bbb3b720ae5bafb7
I20260620 22:07:35.287878 19824 ts_tablet_manager.cc:1918] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:35.287998 19825 ts_tablet_manager.cc:1939] T ab50f198157d4ad6bbb3b720ae5bafb7 P f7d431326b554a7a89c9654f56391868: Deleting consensus metadata
I20260620 22:07:35.288010 19824 log.cc:1196] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/ab50f198157d4ad6bbb3b720ae5bafb7
I20260620 22:07:35.288295 19824 ts_tablet_manager.cc:1939] T ab50f198157d4ad6bbb3b720ae5bafb7 P 9f9f8ea09ea648e796a177920e426b12: Deleting consensus metadata
I20260620 22:07:35.288448 19312 catalog_manager.cc:4841] TS f7d431326b554a7a89c9654f56391868 (127.1.55.195:45569): tablet ab50f198157d4ad6bbb3b720ae5bafb7 (table test-table [id=1492bb5690f54432bce9efdb4695ede4]) successfully deleted
I20260620 22:07:35.288697 19313 catalog_manager.cc:4841] TS 9f9f8ea09ea648e796a177920e426b12 (127.1.55.194:40165): tablet ab50f198157d4ad6bbb3b720ae5bafb7 (table test-table [id=1492bb5690f54432bce9efdb4695ede4]) successfully deleted
W20260620 22:07:35.291435 19313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:33107 (error 108)
I20260620 22:07:35.291641 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 19522
I20260620 22:07:35.292199 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.291797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33107 (local address 127.0.0.1:36296)
0620 22:07:35.292138 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.292170 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326}
W20260620 22:07:35.292433 19313 catalog_manager.cc:4584] TS e5085923367e47e1854b1831d8634851 (127.1.55.193:33107): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ab50f198157d4ad6bbb3b720ae5bafb7: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33107: connect: Connection refused (error 111)
I20260620 22:07:35.295800 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 19656
I20260620 22:07:35.299425 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 19294
2026-06-20T22:07:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1869 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-06-20T22:07:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:35Z Disabled control of system clock
I20260620 22:07:35.324721 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38499
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:37859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:35.398955 19831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:35.399142 19831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:35.399161 19831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:35.400170 19831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:35.400202 19831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:35.400214 19831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:35.400226 19831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:35.400238 19831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:35.401430 19831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38499
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:35.401602 19831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:35.401800 19831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:35.406088 19839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:35.406072 19837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:35.406062 19836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:35.406279 19831 server_base.cc:1034] running on GCE node
I20260620 22:07:35.406490 19831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:35.406708 19831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:35.407903 19831 hybrid_clock.cc:648] HybridClock initialized: now 1781993255407887 us; error 46 us; skew 500 ppm
I20260620 22:07:35.409098 19831 webserver.cc:460] Webserver started at http://127.1.55.254:43245/ using document root <none> and password file <none>
I20260620 22:07:35.409329 19831 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:35.409391 19831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:35.409529 19831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:35.410486 19831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "cd2417aa1b39414f91f9809545b0faac"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "6df942d1c938b0dd5962c3885fd20dc1"
server_key_iv: "6507d4e87bb45f863893d2a9b2507e44"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.410830 19831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "cd2417aa1b39414f91f9809545b0faac"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "6df942d1c938b0dd5962c3885fd20dc1"
server_key_iv: "6507d4e87bb45f863893d2a9b2507e44"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.412004 19831 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:35.412647 19845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.412810 19831 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:35.412899 19831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "cd2417aa1b39414f91f9809545b0faac"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "6df942d1c938b0dd5962c3885fd20dc1"
server_key_iv: "6507d4e87bb45f863893d2a9b2507e44"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.412976 19831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:35.429095 19831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:35.429329 19831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:35.429466 19831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:35.433081 19831 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:38499
I20260620 22:07:35.433109 19897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:38499 every 8 connection(s)
I20260620 22:07:35.433436 19831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:35.434351 19898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:35.436280 19898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac: Bootstrap starting.
I20260620 22:07:35.436759 19898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:35.436991 19898 log.cc:824] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:35.437623 19898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac: No bootstrap required, opened a new log
I20260620 22:07:35.438347 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 19831
I20260620 22:07:35.438446 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:35.438606 1247 external_mini_cluster.cc:1428] Setting key 47d368fbe3129af77348e9a275f827eb
I20260620 22:07:35.439277 19898 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2417aa1b39414f91f9809545b0faac" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38499 } }
I20260620 22:07:35.439458 19898 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:35.439504 19898 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2417aa1b39414f91f9809545b0faac, State: Initialized, Role: FOLLOWER
I20260620 22:07:35.439667 19898 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2417aa1b39414f91f9809545b0faac" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38499 } }
I20260620 22:07:35.439754 19898 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:35.439810 19898 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:35.439863 19898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:35.440335 19898 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2417aa1b39414f91f9809545b0faac" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38499 } }
I20260620 22:07:35.440449 19898 leader_election.cc:302] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd2417aa1b39414f91f9809545b0faac; no voters:
I20260620 22:07:35.440644 19898 leader_election.cc:288] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:35.440673 19903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:35.440774 19903 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [term 1 LEADER]: Becoming Leader. State: Replica: cd2417aa1b39414f91f9809545b0faac, State: Running, Role: LEADER
I20260620 22:07:35.440893 19898 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:35.440908 19903 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2417aa1b39414f91f9809545b0faac" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38499 } }
I20260620 22:07:35.441233 19903 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd2417aa1b39414f91f9809545b0faac. Latest consensus state: current_term: 1 leader_uuid: "cd2417aa1b39414f91f9809545b0faac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2417aa1b39414f91f9809545b0faac" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38499 } } }
I20260620 22:07:35.441246 19904 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd2417aa1b39414f91f9809545b0faac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd2417aa1b39414f91f9809545b0faac" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38499 } } }
I20260620 22:07:35.441520 19904 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:35.441421 19903 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:35.441776 19912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:35.442248 19912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:35.443709 19912 catalog_manager.cc:1347] Generated new cluster ID: aa6065aeaecf466f9660963344f72498
I20260620 22:07:35.443753 19912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:35.444471 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.439072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35826 (local address 127.1.55.254:38499)
0620 22:07:35.439254 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.439278 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.439301 (+ 23us) server_negotiation.cc:407] Connection header received
0620 22:07:35.439399 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.439403 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.439450 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.439595 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:35.439828 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.441330 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.442557 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.443080 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.443189 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.443815 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:35.443818 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:35.443819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:35.443997 (+ 178us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:35.444026 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:35.444035 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:35.444103 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.444172 (+ 69us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.444329 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260620 22:07:35.453322 19912 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:35.453832 19912 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:35.462311 19912 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac: Generated new TSK 0
I20260620 22:07:35.462464 19912 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:35.464226 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38499
--builtin_ntp_servers=127.1.55.212:37859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:35.554091 19922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:35.554247 19922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:35.554265 19922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:35.555311 19922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:35.555346 19922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:35.555367 19922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:07:35.556612 19922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:35.556816 19922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:35.557111 19922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:35.561602 19927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:35.561820 19922 server_base.cc:1034] running on GCE node
W20260620 22:07:35.561935 19930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:35.562019 19928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:35.562244 19922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:35.562511 19922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:35.563699 19922 hybrid_clock.cc:648] HybridClock initialized: now 1781993255563686 us; error 26 us; skew 500 ppm
I20260620 22:07:35.565035 19922 webserver.cc:460] Webserver started at http://127.1.55.193:34227/ using document root <none> and password file <none>
I20260620 22:07:35.565294 19922 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:35.565356 19922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:35.565584 19922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:35.566902 19922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "37c88028d2234e16808185c7492a0b80"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "4578839b161edfc4ae393dee68f611cd"
server_key_iv: "449dd4dacfa132b25d6187e45cd1181a"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.567306 19922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "37c88028d2234e16808185c7492a0b80"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "4578839b161edfc4ae393dee68f611cd"
server_key_iv: "449dd4dacfa132b25d6187e45cd1181a"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.568992 19922 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:07:35.575613 19936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.579802 19922 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.000s sys 0.000s
I20260620 22:07:35.579918 19922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "37c88028d2234e16808185c7492a0b80"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "4578839b161edfc4ae393dee68f611cd"
server_key_iv: "449dd4dacfa132b25d6187e45cd1181a"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.580013 19922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:35.591943 19922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:35.592199 19922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:35.592341 19922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:35.592535 19922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:35.592809 19922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:35.592842 19922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.592862 19922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:35.592903 19922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.598306 19922 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:33837
I20260620 22:07:35.598371 20049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:33837 every 8 connection(s)
I20260620 22:07:35.598655 19922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:07:35.599553 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 19922
I20260620 22:07:35.599673 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:07:35.599884 1247 external_mini_cluster.cc:1428] Setting key 6f52a9b13c34f5ee841317c442dc3be7
I20260620 22:07:35.600811 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38499
--builtin_ntp_servers=127.1.55.212:37859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260620 22:07:35.604008 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.599321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:46283 (local address 127.1.55.254:38499)
0620 22:07:35.599362 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.599364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.599566 (+ 202us) server_negotiation.cc:407] Connection header received
0620 22:07:35.600183 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.600185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.600198 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.600259 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:35.601009 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.601556 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.602514 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.602721 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.602804 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.603713 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:35.603714 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:35.603715 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:35.603720 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:35.603734 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:35.603739 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:35.603795 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.603934 (+ 139us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.603955 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260620 22:07:35.604303 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.599277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38499 (local address 127.1.55.193:46283)
0620 22:07:35.599443 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.599478 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.600073 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.600323 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.600327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.600336 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:35.600811 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.600815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.601645 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.601647 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.602419 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.602422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.602954 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.602954 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.603056 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.603580 (+ 524us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:35.603581 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:35.603606 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:35.603625 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:35.603831 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:35.603838 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:35.603841 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.603932 (+ 91us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.604049 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":56,"threads_started":1}
I20260620 22:07:35.604822 20050 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38499
I20260620 22:07:35.604919 20050 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:35.605123 20050 heartbeater.cc:511] Master 127.1.55.254:38499 requested a full tablet report, sending...
I20260620 22:07:35.605692 19862 ts_manager.cc:194] Registered new tserver with Master: 37c88028d2234e16808185c7492a0b80 (127.1.55.193:33837)
I20260620 22:07:35.606294 19862 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.193:46283
W20260620 22:07:35.675745 20053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:35.675910 20053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:35.675928 20053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:35.677042 20053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:35.677078 20053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:35.677127 20053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:07:35.678435 20053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:35.678665 20053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:35.678956 20053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:35.683420 20059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:35.683430 20058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:35.683486 20061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:35.683730 20053 server_base.cc:1034] running on GCE node
I20260620 22:07:35.683936 20053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:35.684145 20053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:35.685274 20053 hybrid_clock.cc:648] HybridClock initialized: now 1781993255685264 us; error 26 us; skew 500 ppm
I20260620 22:07:35.686359 20053 webserver.cc:460] Webserver started at http://127.1.55.194:37807/ using document root <none> and password file <none>
I20260620 22:07:35.686591 20053 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:35.686657 20053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:35.686785 20053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:35.687711 20053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "1bff050bb7d3494382720b6e6a939d3e"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "c04a426f3360d0cf8023c624d799be88"
server_key_iv: "8905c43f6a36463c978fed8a7833cb48"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.688071 20053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "1bff050bb7d3494382720b6e6a939d3e"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "c04a426f3360d0cf8023c624d799be88"
server_key_iv: "8905c43f6a36463c978fed8a7833cb48"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.689312 20053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:35.690021 20067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.690188 20053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.690271 20053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "1bff050bb7d3494382720b6e6a939d3e"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "c04a426f3360d0cf8023c624d799be88"
server_key_iv: "8905c43f6a36463c978fed8a7833cb48"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.690369 20053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:35.699642 20053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:35.699877 20053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:35.700001 20053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:35.700179 20053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:35.700440 20053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:35.700502 20053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.700536 20053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:35.700577 20053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.705871 20053 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:43743
I20260620 22:07:35.705905 20180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:43743 every 8 connection(s)
I20260620 22:07:35.706235 20053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:07:35.711124 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.706903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:53029 (local address 127.1.55.254:38499)
0620 22:07:35.706947 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.706949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.707178 (+ 229us) server_negotiation.cc:407] Connection header received
0620 22:07:35.707632 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.707633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.707645 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.707702 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:35.708350 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.708844 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.709837 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.710020 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.710107 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.710805 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:35.710806 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:35.710807 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:35.710811 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:35.710826 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:35.710830 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:35.710899 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.711019 (+ 120us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.711047 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:07:35.711374 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.706884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38499 (local address 127.1.55.194:53029)
0620 22:07:35.707059 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.707088 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.707534 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.707770 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.707774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.707782 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:35.708250 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.708254 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.708950 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.708951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.709750 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.709752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.710117 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.710118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.710236 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.710667 (+ 431us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:35.710667 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:35.710691 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:35.710710 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:35.710900 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:35.710906 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:35.710909 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.711014 (+ 105us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.711109 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260620 22:07:35.711817 20181 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38499
I20260620 22:07:35.711889 20181 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:35.712073 20181 heartbeater.cc:511] Master 127.1.55.254:38499 requested a full tablet report, sending...
I20260620 22:07:35.712450 19862 ts_manager.cc:194] Registered new tserver with Master: 1bff050bb7d3494382720b6e6a939d3e (127.1.55.194:43743)
I20260620 22:07:35.712795 19862 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.194:53029
I20260620 22:07:35.715314 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 20053
I20260620 22:07:35.715415 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:07:35.715586 1247 external_mini_cluster.cc:1428] Setting key ea606845194afae5aa09ec0efdb394a2
I20260620 22:07:35.716394 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38499
--builtin_ntp_servers=127.1.55.212:37859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:35.790158 20184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:35.790326 20184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:35.790350 20184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:35.791226 20184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:35.791252 20184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:35.791273 20184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:07:35.792415 20184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:37859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:38499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:35.792551 20184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:35.792727 20184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:35.797012 20192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:35.796998 20190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:35.796988 20189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:35.797276 20184 server_base.cc:1034] running on GCE node
I20260620 22:07:35.797508 20184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:35.797748 20184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:35.798921 20184 hybrid_clock.cc:648] HybridClock initialized: now 1781993255798906 us; error 24 us; skew 500 ppm
I20260620 22:07:35.800186 20184 webserver.cc:460] Webserver started at http://127.1.55.195:36685/ using document root <none> and password file <none>
I20260620 22:07:35.800420 20184 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:35.800482 20184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:35.800602 20184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:35.801690 20184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "1d1118b7cbc54a418e1bddad367cefde"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "92487a6c098f9cc0071f25ec913eb8fe"
server_key_iv: "876ec354c7f7a28b3604908fd1a91e6c"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.802024 20184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "1d1118b7cbc54a418e1bddad367cefde"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "92487a6c098f9cc0071f25ec913eb8fe"
server_key_iv: "876ec354c7f7a28b3604908fd1a91e6c"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.803256 20184 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:35.803912 20198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.804069 20184 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:35.804159 20184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "1d1118b7cbc54a418e1bddad367cefde"
format_stamp: "Formatted at 2026-06-20 22:07:35 on dist-test-slave-xw35"
server_key: "92487a6c098f9cc0071f25ec913eb8fe"
server_key_iv: "876ec354c7f7a28b3604908fd1a91e6c"
server_key_version: "encryptionkey@0"
I20260620 22:07:35.804235 20184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:35.813530 20184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:35.813761 20184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:35.813894 20184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:35.814107 20184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:35.814393 20184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:35.814445 20184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.814481 20184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:35.814509 20184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:35.819883 20184 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:44099
I20260620 22:07:35.819944 20311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:44099 every 8 connection(s)
I20260620 22:07:35.820241 20184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:07:35.824676 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.820817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:33581 (local address 127.1.55.254:38499)
0620 22:07:35.820856 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.820858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.821073 (+ 215us) server_negotiation.cc:407] Connection header received
0620 22:07:35.821512 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.821513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.821526 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.821582 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:35.822149 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.822606 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.823469 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.823663 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.823737 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.824408 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:35.824409 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:35.824409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:35.824414 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:35.824427 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:35.824431 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:35.824494 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.824578 (+ 84us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.824606 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:07:35.824885 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.820794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38499 (local address 127.1.55.195:33581)
0620 22:07:35.820958 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.821008 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.821403 (+ 395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.821639 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.821643 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.821651 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:35.822065 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.822068 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.822688 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.822689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.823373 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.823374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.823746 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.823747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.823864 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.824258 (+ 394us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:35.824258 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:35.824281 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:35.824298 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:35.824497 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:35.824502 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:35.824505 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.824579 (+ 74us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.824661 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":84,"threads_started":1}
I20260620 22:07:35.825273 20312 heartbeater.cc:347] Connected to a master server at 127.1.55.254:38499
I20260620 22:07:35.825335 20312 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:35.825531 20312 heartbeater.cc:511] Master 127.1.55.254:38499 requested a full tablet report, sending...
I20260620 22:07:35.825857 19862 ts_manager.cc:194] Registered new tserver with Master: 1d1118b7cbc54a418e1bddad367cefde (127.1.55.195:44099)
I20260620 22:07:35.826241 19862 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.195:33581
I20260620 22:07:35.830447 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 20184
I20260620 22:07:35.830524 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:07:35.830649 1247 external_mini_cluster.cc:1428] Setting key b862504623a5b6ea2d350fc6bb1492d4
I20260620 22:07:35.831490 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:07:35.835012 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.832638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35828 (local address 127.1.55.254:38499)
0620 22:07:35.832696 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.832697 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.832828 (+ 131us) server_negotiation.cc:407] Connection header received
0620 22:07:35.832850 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.832850 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.832859 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.832900 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:35.833012 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.833404 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.834087 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.834235 (+ 148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.834279 (+ 44us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.834758 (+ 479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:35.834759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:35.834759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:35.834762 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:35.834771 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:35.834774 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:35.834835 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.834917 (+ 82us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.834928 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260620 22:07:35.836364 19862 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:07:35.837858 19862 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:07:35.843696 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.839930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55778 (local address 127.1.55.195:44099)
0620 22:07:35.840056 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.840060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.840269 (+ 209us) server_negotiation.cc:407] Connection header received
0620 22:07:35.840362 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.840364 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.840375 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.840439 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.840588 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.841615 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.842746 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.843367 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.843438 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.843510 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.843600 (+ 90us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.843632 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
I20260620 22:07:35.843711 20320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.839865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:44099 (local address 127.0.0.1:55778)
0620 22:07:35.840213 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.840222 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.840282 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.840488 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.840489 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.840491 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.840522 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.840523 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.841704 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.841705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.842682 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.842684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.843445 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.843445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.843494 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.843503 (+ 9us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.843586 (+ 83us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.843631 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":52,"thread_start_us":62,"threads_started":1}
I20260620 22:07:35.843786 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.839663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33837 (local address 127.0.0.1:53752)
0620 22:07:35.839819 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.839851 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.839911 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.840355 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.840358 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.840360 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.840435 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.840436 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.841751 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.841752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.842778 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.842779 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.843566 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.843567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.843615 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.843618 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.843667 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.843696 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":52,"threads_started":1}
I20260620 22:07:35.844024 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.840000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53752 (local address 127.1.55.193:33837)
0620 22:07:35.840157 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.840160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.840167 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:07:35.840219 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.840221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.840235 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.840592 (+ 357us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.840647 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.841672 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.842859 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.843494 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.843556 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.843627 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.843935 (+ 308us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.843970 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260620 22:07:35.844626 20323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.839671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:43743 (local address 127.0.0.1:58878)
0620 22:07:35.839998 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.840008 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.840058 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.840385 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.840386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.840387 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.840436 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.840438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.841510 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.841511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.842769 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.842772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.844430 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.844431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.844485 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.844488 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.844529 (+ 41us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.844564 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":98,"threads_started":1}
I20260620 22:07:35.844641 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.839818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58878 (local address 127.1.55.194:43743)
0620 22:07:35.840173 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.840177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.840186 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:07:35.840261 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.840263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.840279 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.840386 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.840503 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.841402 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.843659 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.844359 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.844418 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.844489 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.844539 (+ 50us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.844570 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":88,"threads_started":1}
I20260620 22:07:35.844596 20246 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd5e6e4247f4a109ad4533b439cdb5d (DEFAULT_TABLE table=test-table [id=ecac5e323b9f4acfb735e19679d5a9e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:35.844669 19984 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd5e6e4247f4a109ad4533b439cdb5d (DEFAULT_TABLE table=test-table [id=ecac5e323b9f4acfb735e19679d5a9e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:35.844898 20246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd5e6e4247f4a109ad4533b439cdb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:35.844945 19984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd5e6e4247f4a109ad4533b439cdb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:35.845567 20115 tablet_service.cc:1467] Processing CreateTablet for tablet 2dd5e6e4247f4a109ad4533b439cdb5d (DEFAULT_TABLE table=test-table [id=ecac5e323b9f4acfb735e19679d5a9e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:35.845881 20115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2dd5e6e4247f4a109ad4533b439cdb5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:35.848165 20327 tablet_bootstrap.cc:492] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: Bootstrap starting.
I20260620 22:07:35.848425 20328 tablet_bootstrap.cc:492] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Bootstrap starting.
I20260620 22:07:35.848766 20327 tablet_bootstrap.cc:654] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:35.849002 20328 tablet_bootstrap.cc:654] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:35.849045 20327 log.cc:824] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:35.849390 20326 tablet_bootstrap.cc:492] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80: Bootstrap starting.
I20260620 22:07:35.849529 20328 log.cc:824] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:35.849808 20327 tablet_bootstrap.cc:492] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: No bootstrap required, opened a new log
I20260620 22:07:35.849884 20327 ts_tablet_manager.cc:1397] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:35.850005 20326 tablet_bootstrap.cc:654] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:35.850204 20328 tablet_bootstrap.cc:492] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: No bootstrap required, opened a new log
I20260620 22:07:35.850270 20328 ts_tablet_manager.cc:1397] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 22:07:35.850284 20326 log.cc:824] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:35.851089 20326 tablet_bootstrap.cc:492] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80: No bootstrap required, opened a new log
I20260620 22:07:35.851145 20326 ts_tablet_manager.cc:1397] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:35.851938 20327 raft_consensus.cc:348] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.852077 20327 raft_consensus.cc:374] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:35.852116 20327 raft_consensus.cc:729] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d1118b7cbc54a418e1bddad367cefde, State: Initialized, Role: FOLLOWER
I20260620 22:07:35.852234 20327 consensus_queue.cc:260] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.852510 20327 ts_tablet_manager.cc:1428] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:07:35.852648 20312 heartbeater.cc:503] Master 127.1.55.254:38499 was elected leader, sending a full tablet report...
I20260620 22:07:35.852661 20328 raft_consensus.cc:348] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.852807 20328 raft_consensus.cc:374] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:35.852851 20328 raft_consensus.cc:729] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bff050bb7d3494382720b6e6a939d3e, State: Initialized, Role: FOLLOWER
I20260620 22:07:35.852991 20328 consensus_queue.cc:260] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.853223 20328 ts_tablet_manager.cc:1428] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 22:07:35.853276 20181 heartbeater.cc:503] Master 127.1.55.254:38499 was elected leader, sending a full tablet report...
I20260620 22:07:35.853613 20326 raft_consensus.cc:348] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.853746 20326 raft_consensus.cc:374] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:35.853793 20326 raft_consensus.cc:729] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c88028d2234e16808185c7492a0b80, State: Initialized, Role: FOLLOWER
I20260620 22:07:35.853894 20326 consensus_queue.cc:260] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.854125 20326 ts_tablet_manager.cc:1428] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:07:35.854151 20050 heartbeater.cc:503] Master 127.1.55.254:38499 was elected leader, sending a full tablet report...
W20260620 22:07:35.956724 20182 tablet.cc:2369] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:07:35.987457 20334 raft_consensus.cc:482] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:35.987583 20334 raft_consensus.cc:504] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.987967 20334 leader_election.cc:288] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d1118b7cbc54a418e1bddad367cefde (127.1.55.195:44099), 1bff050bb7d3494382720b6e6a939d3e (127.1.55.194:43743)
I20260620 22:07:35.991746 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.988228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:36295 (local address 127.1.55.195:44099)
0620 22:07:35.988307 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.988309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.988403 (+ 94us) server_negotiation.cc:407] Connection header received
0620 22:07:35.988441 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.988443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.988451 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.988506 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.988690 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.989405 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.990889 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.991415 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.991486 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.991493 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.991641 (+ 148us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.991676 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260620 22:07:35.991746 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.988316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:38071 (local address 127.1.55.194:43743)
0620 22:07:35.988396 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:35.988398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:35.988407 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:07:35.988437 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:35.988438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:35.988448 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:35.988506 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:35.988687 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.989409 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.990889 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.991424 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.991486 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.991493 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:35.991641 (+ 148us) server_negotiation.cc:299] Negotiation successful
0620 22:07:35.991678 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 22:07:35.991757 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.988129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:43743 (local address 127.1.55.193:38071)
0620 22:07:35.988182 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.988195 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.988235 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.988522 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.988522 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.988523 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.988616 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.988618 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.989518 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.989518 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.990790 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.990793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.991493 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.991494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.991566 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.991570 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.991622 (+ 52us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.991668 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":74}
I20260620 22:07:35.991762 20335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:35.988142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:44099 (local address 127.1.55.193:36295)
0620 22:07:35.988317 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:35.988328 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:35.988400 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:35.988520 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:35.988521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:35.988523 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:35.988620 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.988621 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.989518 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.989518 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.990816 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:35.990817 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:35.991495 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:35.991496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:35.991566 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:35.991570 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:07:35.991622 (+ 52us) client_negotiation.cc:240] Negotiation successful
0620 22:07:35.991665 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":89,"thread_start_us":99,"threads_started":1}
I20260620 22:07:35.992111 20135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dd5e6e4247f4a109ad4533b439cdb5d" candidate_uuid: "37c88028d2234e16808185c7492a0b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff050bb7d3494382720b6e6a939d3e" is_pre_election: true
I20260620 22:07:35.992117 20266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dd5e6e4247f4a109ad4533b439cdb5d" candidate_uuid: "37c88028d2234e16808185c7492a0b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d1118b7cbc54a418e1bddad367cefde" is_pre_election: true
I20260620 22:07:35.992254 20135 raft_consensus.cc:2454] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37c88028d2234e16808185c7492a0b80 in term 0.
I20260620 22:07:35.992254 20266 raft_consensus.cc:2454] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37c88028d2234e16808185c7492a0b80 in term 0.
I20260620 22:07:35.992491 19940 leader_election.cc:302] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff050bb7d3494382720b6e6a939d3e, 37c88028d2234e16808185c7492a0b80; no voters:
I20260620 22:07:35.992632 20334 raft_consensus.cc:2781] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:07:35.992686 20334 raft_consensus.cc:482] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:07:35.992738 20334 raft_consensus.cc:3037] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:35.993541 20334 raft_consensus.cc:504] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.993703 20334 leader_election.cc:288] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [CANDIDATE]: Term 1 election: Requested vote from peers 1d1118b7cbc54a418e1bddad367cefde (127.1.55.195:44099), 1bff050bb7d3494382720b6e6a939d3e (127.1.55.194:43743)
I20260620 22:07:35.993876 20135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dd5e6e4247f4a109ad4533b439cdb5d" candidate_uuid: "37c88028d2234e16808185c7492a0b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bff050bb7d3494382720b6e6a939d3e"
I20260620 22:07:35.993861 20266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2dd5e6e4247f4a109ad4533b439cdb5d" candidate_uuid: "37c88028d2234e16808185c7492a0b80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d1118b7cbc54a418e1bddad367cefde"
I20260620 22:07:35.993952 20266 raft_consensus.cc:3037] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:35.993963 20135 raft_consensus.cc:3037] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:35.994836 20266 raft_consensus.cc:2454] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37c88028d2234e16808185c7492a0b80 in term 1.
I20260620 22:07:35.994835 20135 raft_consensus.cc:2454] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37c88028d2234e16808185c7492a0b80 in term 1.
I20260620 22:07:35.995026 19940 leader_election.cc:302] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bff050bb7d3494382720b6e6a939d3e, 37c88028d2234e16808185c7492a0b80; no voters:
I20260620 22:07:35.995138 20334 raft_consensus.cc:2781] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:35.995353 20334 raft_consensus.cc:686] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 1 LEADER]: Becoming Leader. State: Replica: 37c88028d2234e16808185c7492a0b80, State: Running, Role: LEADER
I20260620 22:07:35.995458 20334 consensus_queue.cc:237] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } }
I20260620 22:07:35.996309 19861 catalog_manager.cc:5495] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37c88028d2234e16808185c7492a0b80 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "37c88028d2234e16808185c7492a0b80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c88028d2234e16808185c7492a0b80" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 33837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 } health_report { overall_health: UNKNOWN } } }
I20260620 22:07:36.022601 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:36.020548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53754 (local address 127.1.55.193:33837)
0620 22:07:36.020601 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:36.020603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:36.020610 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:07:36.020679 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:36.020679 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:36.020694 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:36.020747 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:07:36.020852 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:36.021230 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:36.021947 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:36.022132 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:36.022181 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:36.022290 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:07:36.022364 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:07:36.022427 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:36.022464 (+ 37us) server_negotiation.cc:299] Negotiation successful
0620 22:07:36.022473 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:07:36.024225 20135 raft_consensus.cc:1261] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 1 FOLLOWER]: Refusing update from remote peer 37c88028d2234e16808185c7492a0b80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:36.024225 20266 raft_consensus.cc:1261] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 1 FOLLOWER]: Refusing update from remote peer 37c88028d2234e16808185c7492a0b80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:36.024552 20336 consensus_queue.cc:1035] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bff050bb7d3494382720b6e6a939d3e" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 43743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:36.024678 20334 consensus_queue.cc:1035] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d1118b7cbc54a418e1bddad367cefde" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:36.027258 20340 mvcc.cc:205] Tried to move back new op lower bound from 7299044376672571392 to 7299044376558026752. Current Snapshot: MvccSnapshot[applied={T|T < 7299044376672571392}]
I20260620 22:07:36.028985 19861 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:36.029086 19861 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:36.029829 19861 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd2417aa1b39414f91f9809545b0faac: Sending DeleteTablet for 3 replicas of tablet 2dd5e6e4247f4a109ad4533b439cdb5d
I20260620 22:07:36.030090 19984 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dd5e6e4247f4a109ad4533b439cdb5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:36 UTC) from {username='slave'} at 127.0.0.1:53752
I20260620 22:07:36.030112 20115 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dd5e6e4247f4a109ad4533b439cdb5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:36 UTC) from {username='slave'} at 127.0.0.1:58878
I20260620 22:07:36.030133 20246 tablet_service.cc:1514] Processing DeleteTablet for tablet 2dd5e6e4247f4a109ad4533b439cdb5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:36 UTC) from {username='slave'} at 127.0.0.1:55778
I20260620 22:07:36.030301 20349 tablet_replica.cc:330] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: stopping tablet replica
I20260620 22:07:36.030395 20349 raft_consensus.cc:2229] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:36.030423 20350 tablet_replica.cc:330] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: stopping tablet replica
I20260620 22:07:36.030488 20349 raft_consensus.cc:2258] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:36.030582 20348 tablet_replica.cc:330] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80: stopping tablet replica
I20260620 22:07:36.030638 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 19922
I20260620 22:07:36.030661 20348 raft_consensus.cc:2229] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:07:36.030757 20348 raft_consensus.cc:2258] T 2dd5e6e4247f4a109ad4533b439cdb5d P 37c88028d2234e16808185c7492a0b80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:36.030892 20349 ts_tablet_manager.cc:1905] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:36.032485 20349 ts_tablet_manager.cc:1918] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:36.032528 20349 log.cc:1196] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/2dd5e6e4247f4a109ad4533b439cdb5d
I20260620 22:07:36.032691 20349 ts_tablet_manager.cc:1939] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1d1118b7cbc54a418e1bddad367cefde: Deleting consensus metadata
I20260620 22:07:36.033013 19846 catalog_manager.cc:4841] TS 1d1118b7cbc54a418e1bddad367cefde (127.1.55.195:44099): tablet 2dd5e6e4247f4a109ad4533b439cdb5d (table test-table [id=ecac5e323b9f4acfb735e19679d5a9e0]) successfully deleted
I20260620 22:07:36.034089 20350 raft_consensus.cc:2229] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:36.034219 20350 raft_consensus.cc:2258] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:36.034550 20350 ts_tablet_manager.cc:1905] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:36.035823 20350 ts_tablet_manager.cc:1918] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:36.035900 20350 log.cc:1196] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/2dd5e6e4247f4a109ad4533b439cdb5d
I20260620 22:07:36.036121 20350 ts_tablet_manager.cc:1939] T 2dd5e6e4247f4a109ad4533b439cdb5d P 1bff050bb7d3494382720b6e6a939d3e: Deleting consensus metadata
I20260620 22:07:36.036506 19849 catalog_manager.cc:4841] TS 1bff050bb7d3494382720b6e6a939d3e (127.1.55.194:43743): tablet 2dd5e6e4247f4a109ad4533b439cdb5d (table test-table [id=ecac5e323b9f4acfb735e19679d5a9e0]) successfully deleted
W20260620 22:07:36.036952 19846 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:33837 (error 108)
I20260620 22:07:36.037176 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 20053
I20260620 22:07:36.037436 20323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:36.037325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:33837 (local address 127.0.0.1:53764)
0620 22:07:36.037367 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:36.037402 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260620 22:07:36.037542 19846 catalog_manager.cc:4584] TS 37c88028d2234e16808185c7492a0b80 (127.1.55.193:33837): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2dd5e6e4247f4a109ad4533b439cdb5d: Network error: Client connection negotiation failed: client connection to 127.1.55.193:33837: connect: Connection refused (error 111)
I20260620 22:07:36.042667 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 20184
I20260620 22:07:36.046718 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 19831
2026-06-20T22:07:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (746 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:36 dist-test-slave-xw35 krb5kdc[20354](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:36 dist-test-slave-xw35 krb5kdc[20354](info): set up 2 sockets
Jun 20 22:07:36 dist-test-slave-xw35 krb5kdc[20354](info): commencing operation
krb5kdc: starting...
W20260620 22:07:37.017258 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.952s user 0.000s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:07:37.120018 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:36297
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:36297
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:37.193914 20367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:37.194116 20367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:37.194149 20367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:37.195182 20367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:37.195243 20367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:37.195264 20367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:37.195284 20367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:37.195315 20367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:37.196656 20367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:36297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:36297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:37.196926 20367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:37.197146 20367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:37.201438 20372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.201464 20375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.201438 20373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:37.201705 20367 server_base.cc:1034] running on GCE node
I20260620 22:07:37.201973 20367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:37.202234 20367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:37.203387 20367 hybrid_clock.cc:648] HybridClock initialized: now 1781993257203367 us; error 33 us; skew 500 ppm
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:37.205721 20367 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:37.206067 20367 webserver.cc:460] Webserver started at http://127.1.55.254:37483/ using document root <none> and password file <none>
I20260620 22:07:37.206251 20367 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:37.206291 20367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:37.206377 20367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:37.207279 20367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "2160de01b0424ef0b67ac16662010d6f"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "ee11fcd63bbcac483e6ad0310cfec790"
server_key_iv: "36eee3c6d230d77c315c4343e8710ec5"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.207568 20367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "2160de01b0424ef0b67ac16662010d6f"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "ee11fcd63bbcac483e6ad0310cfec790"
server_key_iv: "36eee3c6d230d77c315c4343e8710ec5"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.208737 20367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:37.209367 20382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.209534 20367 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.209612 20367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "2160de01b0424ef0b67ac16662010d6f"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "ee11fcd63bbcac483e6ad0310cfec790"
server_key_iv: "36eee3c6d230d77c315c4343e8710ec5"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.209657 20367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:37.220815 20367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:37.222357 20367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:37.222484 20367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:37.225770 20367 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:36297
I20260620 22:07:37.225822 20434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:36297 every 8 connection(s)
I20260620 22:07:37.226090 20367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:37.226918 20435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:37.228971 20435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f: Bootstrap starting.
I20260620 22:07:37.229542 20435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:37.229838 20435 log.cc:824] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:37.230504 20435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f: No bootstrap required, opened a new log
I20260620 22:07:37.231905 20435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2160de01b0424ef0b67ac16662010d6f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36297 } }
I20260620 22:07:37.232077 20435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:37.232121 20435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2160de01b0424ef0b67ac16662010d6f, State: Initialized, Role: FOLLOWER
I20260620 22:07:37.232270 20435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2160de01b0424ef0b67ac16662010d6f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36297 } }
I20260620 22:07:37.232349 20435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:37.232389 20435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:37.232438 20435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:37.232887 20435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2160de01b0424ef0b67ac16662010d6f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36297 } }
I20260620 22:07:37.232991 20435 leader_election.cc:302] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2160de01b0424ef0b67ac16662010d6f; no voters:
I20260620 22:07:37.233165 20435 leader_election.cc:288] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:37.233217 20438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:37.233402 20438 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [term 1 LEADER]: Becoming Leader. State: Replica: 2160de01b0424ef0b67ac16662010d6f, State: Running, Role: LEADER
I20260620 22:07:37.233435 20435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:37.233510 20438 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2160de01b0424ef0b67ac16662010d6f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36297 } }
I20260620 22:07:37.233676 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 20367
I20260620 22:07:37.233786 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:37.233954 1247 external_mini_cluster.cc:1428] Setting key c43bd6fc119686621440fa1b26d4edba
I20260620 22:07:37.234146 20439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2160de01b0424ef0b67ac16662010d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2160de01b0424ef0b67ac16662010d6f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36297 } } }
I20260620 22:07:37.234164 20440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2160de01b0424ef0b67ac16662010d6f. Latest consensus state: current_term: 1 leader_uuid: "2160de01b0424ef0b67ac16662010d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2160de01b0424ef0b67ac16662010d6f" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 36297 } } }
I20260620 22:07:37.234221 20439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:37.234246 20440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:37.234695 20447 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:37.235360 20447 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:37.236791 20447 catalog_manager.cc:1347] Generated new cluster ID: 7ae807911118465e9bd6a5b9846a2198
I20260620 22:07:37.236846 20447 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:37.243429 20451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.234493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46978 (local address 127.1.55.254:36297)
0620 22:07:37.235044 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.235051 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.235079 (+ 28us) server_negotiation.cc:407] Connection header received
0620 22:07:37.235213 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.235218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.235283 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.235428 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:37.236110 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.237240 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.238051 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.238434 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.238546 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.240621 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:37.240625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:37.240625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:37.240635 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:37.242086 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.242408 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.242411 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.242411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.242500 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.242688 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.242688 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.242689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.242880 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:37.243017 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.243096 (+ 79us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.243212 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":80,"threads_started":1}
I20260620 22:07:37.255573 20447 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:37.255975 20447 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:37.260092 20447 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f: Generated new TSK 0
I20260620 22:07:37.260250 20447 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.55.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
Entry for principal kudu/127.1.55.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab.
I20260620 22:07:37.288594 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36297
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:37.381238 20461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:37.381429 20461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:37.381451 20461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:37.382529 20461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:37.382565 20461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:37.382607 20461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:07:37.383908 20461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.193.keytab
--principal=kudu/127.1.55.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:37.384122 20461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:37.384358 20461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:37.389061 20469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.389093 20466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.389088 20467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:37.389334 20461 server_base.cc:1034] running on GCE node
I20260620 22:07:37.389575 20461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:37.389765 20461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:37.390921 20461 hybrid_clock.cc:648] HybridClock initialized: now 1781993257390912 us; error 27 us; skew 500 ppm
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:37.393239 20461 init.cc:377] Logged in from keytab as kudu/127.1.55.193@KRBTEST.COM (short username kudu)
I20260620 22:07:37.393702 20461 webserver.cc:460] Webserver started at http://127.1.55.193:39453/ using document root <none> and password file <none>
I20260620 22:07:37.393930 20461 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:37.393975 20461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:37.394122 20461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:37.395126 20461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "04c68d9deab942679042ace103bf9c91"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "94cbb2363ea726a46fd0f8c86e5c12b6"
server_key_iv: "130fdbd08dfec5e6d7dd27695aacd624"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.395469 20461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "04c68d9deab942679042ace103bf9c91"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "94cbb2363ea726a46fd0f8c86e5c12b6"
server_key_iv: "130fdbd08dfec5e6d7dd27695aacd624"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.396740 20461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:37.397399 20476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.397579 20461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:37.397675 20461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "04c68d9deab942679042ace103bf9c91"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "94cbb2363ea726a46fd0f8c86e5c12b6"
server_key_iv: "130fdbd08dfec5e6d7dd27695aacd624"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.397749 20461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:37.412130 20461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:37.414104 20461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:37.414269 20461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:37.414479 20461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:37.414758 20461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:37.414808 20461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.414845 20461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:37.414875 20461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.420262 20461 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:45691
I20260620 22:07:37.420346 20589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:45691 every 8 connection(s)
I20260620 22:07:37.420648 20461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:07:37.423167 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 20461
I20260620 22:07:37.423264 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:07:37.423461 1247 external_mini_cluster.cc:1428] Setting key bee1981c148d0c8e45fad2e24476389c
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.193@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:37.430477 20451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.421336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:36023 (local address 127.1.55.254:36297)
0620 22:07:37.421421 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.421424 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.421616 (+ 192us) server_negotiation.cc:407] Connection header received
0620 22:07:37.422071 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.422071 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.422081 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.422128 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:37.422937 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.423538 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.424903 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.425083 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.425135 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.427258 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:37.427259 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:37.427260 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:37.427267 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:37.428890 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.429265 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.429266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.429267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.429358 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.429731 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.429732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.429733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.429890 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:37.429962 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.430296 (+ 334us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.430391 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260620 22:07:37.430629 20592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.421294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:36297 (local address 127.1.55.193:36023)
0620 22:07:37.421444 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.421535 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:37.421994 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:37.422174 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:37.422178 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:37.422681 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:37.422865 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.422869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.423616 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.423617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.424812 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.424816 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.425166 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.425167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.425308 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.425874 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:37.425882 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:37.427168 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:37.428986 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:37.428992 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:37.428993 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:37.429190 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:37.429429 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:37.429430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:37.429430 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:37.429603 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:37.429970 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:37.429992 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:37.430134 (+ 142us) client_negotiation.cc:769] Sending connection context
0620 22:07:37.430258 (+ 124us) client_negotiation.cc:240] Negotiation successful
0620 22:07:37.430407 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":98,"threads_started":1}
I20260620 22:07:37.431183 20590 heartbeater.cc:347] Connected to a master server at 127.1.55.254:36297
I20260620 22:07:37.431295 20590 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:37.431470 20590 heartbeater.cc:511] Master 127.1.55.254:36297 requested a full tablet report, sending...
I20260620 22:07:37.432142 20399 ts_manager.cc:194] Registered new tserver with Master: 04c68d9deab942679042ace103bf9c91 (127.1.55.193:45691)
WARNING: no policy specified for kudu/127.1.55.194@KRBTEST.COM; defaulting to no policy
I20260620 22:07:37.433001 20399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.193@KRBTEST.COM'} at 127.1.55.193:36023
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
Entry for principal kudu/127.1.55.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab.
I20260620 22:07:37.447921 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36297
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:37.522694 20595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:37.522969 20595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:37.523007 20595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:37.524129 20595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:37.524192 20595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:37.524231 20595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:07:37.525609 20595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.194.keytab
--principal=kudu/127.1.55.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:37.525862 20595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:37.526067 20595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:37.530961 20603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.530969 20600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.530977 20601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:37.531158 20595 server_base.cc:1034] running on GCE node
I20260620 22:07:37.531348 20595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:37.531651 20595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:37.532823 20595 hybrid_clock.cc:648] HybridClock initialized: now 1781993257532785 us; error 37 us; skew 500 ppm
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:37.535262 20595 init.cc:377] Logged in from keytab as kudu/127.1.55.194@KRBTEST.COM (short username kudu)
I20260620 22:07:37.535715 20595 webserver.cc:460] Webserver started at http://127.1.55.194:39239/ using document root <none> and password file <none>
I20260620 22:07:37.535939 20595 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:37.536005 20595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:37.536151 20595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:37.537161 20595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "026416949ff64660a5c0a9153f041db1"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "4fac62c27dc5c409afe08341dd850320"
server_key_iv: "aa06477ad3e3007cf309956afb1a11df"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.537617 20595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "026416949ff64660a5c0a9153f041db1"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "4fac62c27dc5c409afe08341dd850320"
server_key_iv: "aa06477ad3e3007cf309956afb1a11df"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.538942 20595 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:37.539609 20610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.539779 20595 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:37.539880 20595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "026416949ff64660a5c0a9153f041db1"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "4fac62c27dc5c409afe08341dd850320"
server_key_iv: "aa06477ad3e3007cf309956afb1a11df"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.539960 20595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:37.561152 20595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:37.562915 20595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:37.563074 20595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:37.563292 20595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:37.563582 20595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:37.563637 20595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.563669 20595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:37.563696 20595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.569690 20595 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:46181
I20260620 22:07:37.569805 20723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:46181 every 8 connection(s)
I20260620 22:07:37.570067 20595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:07:37.572146 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 20595
I20260620 22:07:37.572247 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:07:37.572445 1247 external_mini_cluster.cc:1428] Setting key 658648e857efee2385caa96bf7af290a
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.194@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:37.580775 20726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.570732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:36297 (local address 127.1.55.194:52833)
0620 22:07:37.570924 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.570970 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:37.571655 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:37.571940 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:37.571944 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:37.572670 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:37.572920 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.572925 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.573853 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.573854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.574951 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.574954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.575491 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.575492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.575626 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.576207 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:37.576218 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:37.577726 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:37.579499 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:37.579505 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:37.579506 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:37.579711 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:37.579947 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:37.579948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:37.579948 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:37.580032 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:37.580307 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:37.580311 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:37.580457 (+ 146us) client_negotiation.cc:769] Sending connection context
0620 22:07:37.580542 (+ 85us) client_negotiation.cc:240] Negotiation successful
0620 22:07:37.580641 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":101,"threads_started":1}
I20260620 22:07:37.580767 20451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.570760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:52833 (local address 127.1.55.254:36297)
0620 22:07:37.570828 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.570830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.571054 (+ 224us) server_negotiation.cc:407] Connection header received
0620 22:07:37.571769 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.571770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.571781 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.571870 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:37.573043 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.573747 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.575056 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.575359 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.575403 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.577821 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:37.577822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:37.577823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:37.577847 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:37.579410 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.579781 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.579782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.579783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.579853 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.580095 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.580096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.580097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.580246 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:37.580323 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.580592 (+ 269us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.580669 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:07:37.581264 20724 heartbeater.cc:347] Connected to a master server at 127.1.55.254:36297
I20260620 22:07:37.581363 20724 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:37.581563 20724 heartbeater.cc:511] Master 127.1.55.254:36297 requested a full tablet report, sending...
I20260620 22:07:37.581897 20399 ts_manager.cc:194] Registered new tserver with Master: 026416949ff64660a5c0a9153f041db1 (127.1.55.194:46181)
WARNING: no policy specified for kudu/127.1.55.195@KRBTEST.COM; defaulting to no policy
I20260620 22:07:37.582269 20399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.194@KRBTEST.COM'} at 127.1.55.194:52833
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
Entry for principal kudu/127.1.55.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab.
I20260620 22:07:37.598562 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36297
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:43737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:37.674965 20729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:37.675148 20729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:37.675169 20729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:37.676303 20729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:37.676343 20729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:37.676395 20729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:07:37.677807 20729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:43737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.195.keytab
--principal=kudu/127.1.55.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:36297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:37.678051 20729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:37.678329 20729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:37.683044 20734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.683043 20735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:37.683214 20729 server_base.cc:1034] running on GCE node
W20260620 22:07:37.683106 20737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:37.683473 20729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:37.683661 20729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:37.684813 20729 hybrid_clock.cc:648] HybridClock initialized: now 1781993257684796 us; error 33 us; skew 500 ppm
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:37.687233 20729 init.cc:377] Logged in from keytab as kudu/127.1.55.195@KRBTEST.COM (short username kudu)
I20260620 22:07:37.687642 20729 webserver.cc:460] Webserver started at http://127.1.55.195:32903/ using document root <none> and password file <none>
I20260620 22:07:37.687884 20729 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:37.687928 20729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:37.688076 20729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:37.689045 20729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "26bbb1f7290b4f37b53a5a6a79a94089"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "2c1ab29bffe9df5d10f8871dc3c75513"
server_key_iv: "330695f2bfd90da40252da14613d3ede"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.689386 20729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "26bbb1f7290b4f37b53a5a6a79a94089"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "2c1ab29bffe9df5d10f8871dc3c75513"
server_key_iv: "330695f2bfd90da40252da14613d3ede"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.690640 20729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:07:37.691339 20744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.691509 20729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:37.691603 20729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "26bbb1f7290b4f37b53a5a6a79a94089"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "2c1ab29bffe9df5d10f8871dc3c75513"
server_key_iv: "330695f2bfd90da40252da14613d3ede"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.691681 20729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:37.722929 20729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:37.724880 20729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:37.725028 20729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:37.725255 20729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:37.725560 20729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:37.725590 20729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.725627 20729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:37.725653 20729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.731331 20729 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:42443
I20260620 22:07:37.731392 20857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:42443 every 8 connection(s)
I20260620 22:07:37.731666 20729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:07:37.732788 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 20729
I20260620 22:07:37.732950 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:07:37.733136 1247 external_mini_cluster.cc:1428] Setting key 063098b1d5c3f5773ad2ad37e9ed7f39
Jun 20 22:07:37 dist-test-slave-xw35 krb5kdc[20354](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993257, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.195@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:37.740617 20451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.732324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:44885 (local address 127.1.55.254:36297)
0620 22:07:37.732362 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.732364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.732571 (+ 207us) server_negotiation.cc:407] Connection header received
0620 22:07:37.733329 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.733331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.733345 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.733404 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:37.734544 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.735152 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.736043 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.736218 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.736285 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.738269 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:37.738271 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:37.738271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:37.738277 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:37.739602 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.739928 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.739928 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.739929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.739974 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.740165 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.740165 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.740165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.740253 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:37.740300 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.740505 (+ 205us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.740558 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:07:37.740797 20860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.732302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:36297 (local address 127.1.55.195:44885)
0620 22:07:37.732466 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.732497 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:37.733156 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:37.733503 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:37.733508 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:37.734215 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:37.734458 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.734463 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.735229 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.735230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.735980 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.735981 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.736320 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.736321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.736413 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.736817 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:07:37.736825 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:37.738190 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:37.739669 (+ 1479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:37.739673 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:37.739675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:37.739868 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:37.740029 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:07:37.740029 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:07:37.740030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:07:37.740114 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:07:37.740303 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:37.740307 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:37.740405 (+ 98us) client_negotiation.cc:769] Sending connection context
0620 22:07:37.740480 (+ 75us) client_negotiation.cc:240] Negotiation successful
0620 22:07:37.740582 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260620 22:07:37.741272 20858 heartbeater.cc:347] Connected to a master server at 127.1.55.254:36297
I20260620 22:07:37.741376 20858 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:37.741569 20858 heartbeater.cc:511] Master 127.1.55.254:36297 requested a full tablet report, sending...
I20260620 22:07:37.741964 20399 ts_manager.cc:194] Registered new tserver with Master: 26bbb1f7290b4f37b53a5a6a79a94089 (127.1.55.195:42443)
I20260620 22:07:37.742312 20399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.55.195@KRBTEST.COM'} at 127.1.55.195:44885
I20260620 22:07:37.744659 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:07:37.750942 20451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.745908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46990 (local address 127.1.55.254:36297)
0620 22:07:37.745960 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.745961 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.746039 (+ 78us) server_negotiation.cc:407] Connection header received
0620 22:07:37.746084 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.746084 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.746091 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.746142 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:37.746617 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.747059 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.747707 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.747905 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.747952 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.749030 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:37.749031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:37.749031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:37.749035 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:37.750164 (+ 1129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.750430 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.750430 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.750430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.750472 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:37.750606 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:37.750607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:37.750607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:37.750707 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:37.750766 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.750847 (+ 81us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.750893 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 22:07:37.752225 20399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46990:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:07:37.753803 20399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:07:37.759639 20866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.755678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:46181 (local address 127.0.0.1:36300)
0620 22:07:37.755905 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.755914 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:37.755953 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:37.756224 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:37.756227 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:37.756228 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:37.756305 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.756309 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.757657 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.757659 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.758548 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.758550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.759347 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.759349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.759435 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.759450 (+ 15us) client_negotiation.cc:769] Sending connection context
0620 22:07:37.759513 (+ 63us) client_negotiation.cc:240] Negotiation successful
0620 22:07:37.759561 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":53,"thread_start_us":50,"threads_started":1}
I20260620 22:07:37.759897 20870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.755878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49656 (local address 127.1.55.195:42443)
0620 22:07:37.756024 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.756028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.756451 (+ 423us) server_negotiation.cc:407] Connection header received
0620 22:07:37.756489 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.756492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.756505 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.756595 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:37.756784 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.757427 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.758896 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.759574 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.759645 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.759695 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.759797 (+ 102us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.759832 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260620 22:07:37.759902 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.755678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:42443 (local address 127.0.0.1:49656)
0620 22:07:37.756331 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.756341 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:37.756393 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:37.756660 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:37.756661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:37.756663 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:37.756705 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.756707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.757563 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.757564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.758795 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.758798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.759644 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.759645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.759710 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.759715 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:07:37.759782 (+ 67us) client_negotiation.cc:240] Negotiation successful
0620 22:07:37.759826 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"mutex_wait_us":75,"spinlock_wait_cycles":384,"thread_start_us":97,"threads_started":1}
I20260620 22:07:37.759955 20869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.755736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41630 (local address 127.1.55.193:45691)
0620 22:07:37.756106 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.756110 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.756118 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:07:37.756152 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.756154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.756167 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.756257 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:37.756411 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.757532 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.758912 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.759431 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.759506 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.759561 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.759822 (+ 261us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.759873 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":99,"threads_started":1}
I20260620 22:07:37.760402 20871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.755879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36300 (local address 127.1.55.194:46181)
0620 22:07:37.756040 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.756043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.756054 (+ 11us) server_negotiation.cc:407] Connection header received
0620 22:07:37.756096 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.756098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.756113 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.756227 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:37.756405 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.757562 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.758626 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.759251 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.759324 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.759376 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.760292 (+ 916us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.760352 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":67,"threads_started":1}
I20260620 22:07:37.759754 20868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.755638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:45691 (local address 127.0.0.1:41630)
0620 22:07:37.755818 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.755866 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:37.755931 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:37.756270 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:37.756271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:37.756272 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:37.756306 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.756307 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.757619 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.757619 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.758796 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.758798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.759518 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.759519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.759582 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.759587 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:07:37.759637 (+ 50us) client_negotiation.cc:240] Negotiation successful
0620 22:07:37.759679 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":45,"thread_start_us":44,"threads_started":1}
I20260620 22:07:37.760584 20792 tablet_service.cc:1467] Processing CreateTablet for tablet 737fb51e42444474b8547eaaf22788ad (DEFAULT_TABLE table=test-table [id=860a0d687cf94deead00e20fba690f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:37.760885 20792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 737fb51e42444474b8547eaaf22788ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:37.760979 20658 tablet_service.cc:1467] Processing CreateTablet for tablet 737fb51e42444474b8547eaaf22788ad (DEFAULT_TABLE table=test-table [id=860a0d687cf94deead00e20fba690f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:37.761251 20658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 737fb51e42444474b8547eaaf22788ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:37.761936 20524 tablet_service.cc:1467] Processing CreateTablet for tablet 737fb51e42444474b8547eaaf22788ad (DEFAULT_TABLE table=test-table [id=860a0d687cf94deead00e20fba690f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:37.762184 20524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 737fb51e42444474b8547eaaf22788ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:37.763937 20872 tablet_bootstrap.cc:492] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: Bootstrap starting.
I20260620 22:07:37.764303 20873 tablet_bootstrap.cc:492] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: Bootstrap starting.
I20260620 22:07:37.764539 20874 tablet_bootstrap.cc:492] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91: Bootstrap starting.
I20260620 22:07:37.764933 20873 tablet_bootstrap.cc:654] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:37.765012 20872 tablet_bootstrap.cc:654] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:37.765134 20874 tablet_bootstrap.cc:654] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:37.765538 20872 log.cc:824] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:37.765561 20873 log.cc:824] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:37.765681 20874 log.cc:824] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:37.766249 20873 tablet_bootstrap.cc:492] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: No bootstrap required, opened a new log
I20260620 22:07:37.766301 20873 ts_tablet_manager.cc:1397] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:07:37.766270 20872 tablet_bootstrap.cc:492] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: No bootstrap required, opened a new log
I20260620 22:07:37.766367 20872 ts_tablet_manager.cc:1397] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260620 22:07:37.767611 20873 raft_consensus.cc:348] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.767795 20873 raft_consensus.cc:374] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:37.767663 20872 raft_consensus.cc:348] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.767850 20873 raft_consensus.cc:729] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 026416949ff64660a5c0a9153f041db1, State: Initialized, Role: FOLLOWER
I20260620 22:07:37.767872 20872 raft_consensus.cc:374] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:37.767915 20872 raft_consensus.cc:729] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26bbb1f7290b4f37b53a5a6a79a94089, State: Initialized, Role: FOLLOWER
I20260620 22:07:37.767968 20873 consensus_queue.cc:260] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.768026 20872 consensus_queue.cc:260] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.768244 20873 ts_tablet_manager.cc:1428] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:07:37.768275 20872 ts_tablet_manager.cc:1428] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 22:07:37.768299 20858 heartbeater.cc:503] Master 127.1.55.254:36297 was elected leader, sending a full tablet report...
I20260620 22:07:37.768252 20724 heartbeater.cc:503] Master 127.1.55.254:36297 was elected leader, sending a full tablet report...
I20260620 22:07:37.768728 20874 tablet_bootstrap.cc:492] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91: No bootstrap required, opened a new log
I20260620 22:07:37.768796 20874 ts_tablet_manager.cc:1397] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260620 22:07:37.770246 20874 raft_consensus.cc:348] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.770390 20874 raft_consensus.cc:374] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:37.770431 20874 raft_consensus.cc:729] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04c68d9deab942679042ace103bf9c91, State: Initialized, Role: FOLLOWER
I20260620 22:07:37.770524 20874 consensus_queue.cc:260] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.770743 20874 ts_tablet_manager.cc:1428] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 22:07:37.770803 20590 heartbeater.cc:503] Master 127.1.55.254:36297 was elected leader, sending a full tablet report...
I20260620 22:07:37.779793 20880 raft_consensus.cc:482] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:37.779887 20880 raft_consensus.cc:504] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.780217 20880 leader_election.cc:288] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26bbb1f7290b4f37b53a5a6a79a94089 (127.1.55.195:42443), 026416949ff64660a5c0a9153f041db1 (127.1.55.194:46181)
I20260620 22:07:37.782986 20870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.780416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:54853 (local address 127.1.55.195:42443)
0620 22:07:37.780472 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.780475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.780485 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:07:37.780520 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.780521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.780531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.780589 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:37.780773 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.781286 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.782219 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.782652 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.782705 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.782711 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.782884 (+ 173us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.782917 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 22:07:37.782969 20592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.780335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:42443 (local address 127.1.55.193:54853)
0620 22:07:37.780394 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.780406 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:37.780446 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:37.780602 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:37.780603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:37.780605 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:37.780693 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.780695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.781371 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.781372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.782134 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.782135 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.782723 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.782724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.782801 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.782806 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:07:37.782864 (+ 58us) client_negotiation.cc:240] Negotiation successful
0620 22:07:37.782906 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260620 22:07:37.783144 20881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.780357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:46181 (local address 127.1.55.193:60693)
0620 22:07:37.780501 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.780522 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:37.780579 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:37.780743 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:37.780744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:37.780758 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:37.780831 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.780832 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.781443 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.781443 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.782254 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:37.782256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.782875 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.782876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:37.782944 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.782949 (+ 5us) client_negotiation.cc:769] Sending connection context
0620 22:07:37.783008 (+ 59us) client_negotiation.cc:240] Negotiation successful
0620 22:07:37.783049 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260620 22:07:37.783147 20871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.780419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:60693 (local address 127.1.55.194:46181)
0620 22:07:37.780458 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.780460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.780589 (+ 129us) server_negotiation.cc:407] Connection header received
0620 22:07:37.780647 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.780648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.780659 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.780717 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:37.780896 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.781366 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.782350 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.782763 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.782834 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.782865 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.783024 (+ 159us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.783069 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:07:37.783282 20812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "737fb51e42444474b8547eaaf22788ad" candidate_uuid: "04c68d9deab942679042ace103bf9c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" is_pre_election: true
I20260620 22:07:37.783371 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "737fb51e42444474b8547eaaf22788ad" candidate_uuid: "04c68d9deab942679042ace103bf9c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026416949ff64660a5c0a9153f041db1" is_pre_election: true
I20260620 22:07:37.783432 20812 raft_consensus.cc:2454] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04c68d9deab942679042ace103bf9c91 in term 0.
I20260620 22:07:37.783478 20678 raft_consensus.cc:2454] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04c68d9deab942679042ace103bf9c91 in term 0.
I20260620 22:07:37.783711 20479 leader_election.cc:302] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026416949ff64660a5c0a9153f041db1, 04c68d9deab942679042ace103bf9c91; no voters:
I20260620 22:07:37.783829 20880 raft_consensus.cc:2781] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:07:37.783907 20880 raft_consensus.cc:482] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:07:37.783931 20880 raft_consensus.cc:3037] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:37.784528 20880 raft_consensus.cc:504] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.784653 20880 leader_election.cc:288] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [CANDIDATE]: Term 1 election: Requested vote from peers 26bbb1f7290b4f37b53a5a6a79a94089 (127.1.55.195:42443), 026416949ff64660a5c0a9153f041db1 (127.1.55.194:46181)
I20260620 22:07:37.784763 20812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "737fb51e42444474b8547eaaf22788ad" candidate_uuid: "04c68d9deab942679042ace103bf9c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26bbb1f7290b4f37b53a5a6a79a94089"
I20260620 22:07:37.784787 20678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "737fb51e42444474b8547eaaf22788ad" candidate_uuid: "04c68d9deab942679042ace103bf9c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026416949ff64660a5c0a9153f041db1"
I20260620 22:07:37.784842 20812 raft_consensus.cc:3037] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:37.784842 20678 raft_consensus.cc:3037] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:37.785712 20812 raft_consensus.cc:2454] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04c68d9deab942679042ace103bf9c91 in term 1.
I20260620 22:07:37.785750 20678 raft_consensus.cc:2454] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04c68d9deab942679042ace103bf9c91 in term 1.
I20260620 22:07:37.785892 20479 leader_election.cc:302] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026416949ff64660a5c0a9153f041db1, 04c68d9deab942679042ace103bf9c91; no voters:
I20260620 22:07:37.785975 20880 raft_consensus.cc:2781] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:37.786123 20880 raft_consensus.cc:686] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [term 1 LEADER]: Becoming Leader. State: Replica: 04c68d9deab942679042ace103bf9c91, State: Running, Role: LEADER
I20260620 22:07:37.786226 20880 consensus_queue.cc:237] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } }
I20260620 22:07:37.786913 20398 catalog_manager.cc:5495] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04c68d9deab942679042ace103bf9c91 (127.1.55.193). New cstate: current_term: 1 leader_uuid: "04c68d9deab942679042ace103bf9c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04c68d9deab942679042ace103bf9c91" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 45691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 } health_report { overall_health: UNKNOWN } } }
I20260620 22:07:37.795713 20869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.793249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41636 (local address 127.1.55.193:45691)
0620 22:07:37.793291 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.793293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.793303 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:07:37.793349 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.793349 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.793374 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.793440 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:07:37.793611 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.794146 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.794909 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.795143 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.795224 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.795404 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:07:37.795502 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:07:37.795591 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.795609 (+ 18us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.795627 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:07:37.797266 20812 raft_consensus.cc:1261] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 1 FOLLOWER]: Refusing update from remote peer 04c68d9deab942679042ace103bf9c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:37.797586 20678 raft_consensus.cc:1261] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 1 FOLLOWER]: Refusing update from remote peer 04c68d9deab942679042ace103bf9c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:37.797627 20882 consensus_queue.cc:1035] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26bbb1f7290b4f37b53a5a6a79a94089" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 42443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:37.797859 20882 consensus_queue.cc:1035] T 737fb51e42444474b8547eaaf22788ad P 04c68d9deab942679042ace103bf9c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "026416949ff64660a5c0a9153f041db1" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 46181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:37.799938 20885 mvcc.cc:205] Tried to move back new op lower bound from 7299044383935164416 to 7299044383892918272. Current Snapshot: MvccSnapshot[applied={T|T < 7299044383935164416}]
I20260620 22:07:37.800083 20886 mvcc.cc:205] Tried to move back new op lower bound from 7299044383935164416 to 7299044383892918272. Current Snapshot: MvccSnapshot[applied={T|T < 7299044383935164416}]
I20260620 22:07:37.800566 20887 mvcc.cc:205] Tried to move back new op lower bound from 7299044383935164416 to 7299044383892918272. Current Snapshot: MvccSnapshot[applied={T|T < 7299044383935164416}]
I20260620 22:07:37.802071 20398 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46990:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:37.802171 20398 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46990:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:37.802914 20398 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2160de01b0424ef0b67ac16662010d6f: Sending DeleteTablet for 3 replicas of tablet 737fb51e42444474b8547eaaf22788ad
I20260620 22:07:37.803241 20792 tablet_service.cc:1514] Processing DeleteTablet for tablet 737fb51e42444474b8547eaaf22788ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:37 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:49656
I20260620 22:07:37.803244 20658 tablet_service.cc:1514] Processing DeleteTablet for tablet 737fb51e42444474b8547eaaf22788ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:37 UTC) from {username='kudu', principal='kudu/127.1.55.254@KRBTEST.COM'} at 127.0.0.1:36300
I20260620 22:07:37.803455 20896 tablet_replica.cc:330] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: stopping tablet replica
I20260620 22:07:37.803544 20896 raft_consensus.cc:2229] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:37.803648 20896 raft_consensus.cc:2258] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:37.803714 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 20461
I20260620 22:07:37.804590 20896 ts_tablet_manager.cc:1905] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:37.804956 20895 tablet_replica.cc:330] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: stopping tablet replica
I20260620 22:07:37.805039 20895 raft_consensus.cc:2229] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:37.805120 20895 raft_consensus.cc:2258] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:37.806151 20895 ts_tablet_manager.cc:1905] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:37.806304 20896 ts_tablet_manager.cc:1918] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:37.806372 20896 log.cc:1196] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/737fb51e42444474b8547eaaf22788ad
I20260620 22:07:37.806640 20896 ts_tablet_manager.cc:1939] T 737fb51e42444474b8547eaaf22788ad P 26bbb1f7290b4f37b53a5a6a79a94089: Deleting consensus metadata
I20260620 22:07:37.807047 20384 catalog_manager.cc:4841] TS 26bbb1f7290b4f37b53a5a6a79a94089 (127.1.55.195:42443): tablet 737fb51e42444474b8547eaaf22788ad (table test-table [id=860a0d687cf94deead00e20fba690f0f]) successfully deleted
I20260620 22:07:37.807618 20895 ts_tablet_manager.cc:1918] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:37.807672 20895 log.cc:1196] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/737fb51e42444474b8547eaaf22788ad
I20260620 22:07:37.807869 20895 ts_tablet_manager.cc:1939] T 737fb51e42444474b8547eaaf22788ad P 026416949ff64660a5c0a9153f041db1: Deleting consensus metadata
I20260620 22:07:37.808187 20385 catalog_manager.cc:4841] TS 026416949ff64660a5c0a9153f041db1 (127.1.55.194:46181): tablet 737fb51e42444474b8547eaaf22788ad (table test-table [id=860a0d687cf94deead00e20fba690f0f]) successfully deleted
W20260620 22:07:37.809557 20386 connection.cc:535] client connection to 127.1.55.193:45691 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 22:07:37.809649 20386 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260620 22:07:37.810076 20868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.809953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:45691 (local address 127.0.0.1:41650)
0620 22:07:37.810012 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:37.810054 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:45691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260620 22:07:37.810078 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 20595
W20260620 22:07:37.813573 20386 catalog_manager.cc:4584] TS 04c68d9deab942679042ace103bf9c91 (127.1.55.193:45691): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 737fb51e42444474b8547eaaf22788ad: Network error: Client connection negotiation failed: client connection to 127.1.55.193:45691: connect: Connection refused (error 111)
I20260620 22:07:37.815407 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 20729
I20260620 22:07:37.819528 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 20367
2026-06-20T22:07:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1773 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-06-20T22:07:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:37Z Disabled control of system clock
I20260620 22:07:37.845068 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46301
--webserver_interface=127.1.55.254
--webserver_port=0
--builtin_ntp_servers=127.1.55.212:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:46301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:37.920914 20901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:37.921101 20901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:37.921121 20901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:37.922247 20901 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:37.922294 20901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:37.922314 20901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:37.922325 20901 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:37.922336 20901 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:37.923571 20901 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:46301
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:46301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:37.923729 20901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:37.923923 20901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:37.928414 20906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.928408 20909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:37.928439 20907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:37.928443 20901 server_base.cc:1034] running on GCE node
I20260620 22:07:37.928768 20901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:37.929214 20901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:37.930393 20901 hybrid_clock.cc:648] HybridClock initialized: now 1781993257930380 us; error 26 us; skew 500 ppm
I20260620 22:07:37.931699 20901 webserver.cc:460] Webserver started at http://127.1.55.254:39567/ using document root <none> and password file <none>
I20260620 22:07:37.931936 20901 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:37.932004 20901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:37.932149 20901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:37.933104 20901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "1221fb70bdad4314b7fc305f2dc93166"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "7bd987f9a1802463b6f796bfa4d207e4"
server_key_iv: "0168dc19ef1bb906229acb305d77bf8c"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.933442 20901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "1221fb70bdad4314b7fc305f2dc93166"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "7bd987f9a1802463b6f796bfa4d207e4"
server_key_iv: "0168dc19ef1bb906229acb305d77bf8c"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.934676 20901 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:37.935352 20915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:37.935511 20901 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:37.935599 20901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "1221fb70bdad4314b7fc305f2dc93166"
format_stamp: "Formatted at 2026-06-20 22:07:37 on dist-test-slave-xw35"
server_key: "7bd987f9a1802463b6f796bfa4d207e4"
server_key_iv: "0168dc19ef1bb906229acb305d77bf8c"
server_key_version: "encryptionkey@0"
I20260620 22:07:37.935674 20901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:37.949430 20901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:37.949717 20901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:37.949867 20901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:37.953342 20901 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:46301
I20260620 22:07:37.953405 20967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:46301 every 8 connection(s)
I20260620 22:07:37.953786 20901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:37.954670 20968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:37.956754 20968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166: Bootstrap starting.
I20260620 22:07:37.957310 20968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:37.957662 20968 log.cc:824] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:37.958273 20968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166: No bootstrap required, opened a new log
I20260620 22:07:37.958747 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 20901
I20260620 22:07:37.958838 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:37.959039 1247 external_mini_cluster.cc:1428] Setting key 51f3add38baa0e499cddbc958ef82dce
I20260620 22:07:37.960443 20968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1221fb70bdad4314b7fc305f2dc93166" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46301 } }
I20260620 22:07:37.960628 20968 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:37.960666 20968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1221fb70bdad4314b7fc305f2dc93166, State: Initialized, Role: FOLLOWER
I20260620 22:07:37.960812 20968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1221fb70bdad4314b7fc305f2dc93166" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46301 } }
I20260620 22:07:37.960896 20968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:37.960927 20968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:37.960966 20968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:37.961689 20968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1221fb70bdad4314b7fc305f2dc93166" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46301 } }
I20260620 22:07:37.961791 20968 leader_election.cc:302] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1221fb70bdad4314b7fc305f2dc93166; no voters:
I20260620 22:07:37.961957 20968 leader_election.cc:288] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:37.962028 20973 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:37.962164 20973 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [term 1 LEADER]: Becoming Leader. State: Replica: 1221fb70bdad4314b7fc305f2dc93166, State: Running, Role: LEADER
I20260620 22:07:37.962276 20973 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1221fb70bdad4314b7fc305f2dc93166" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46301 } }
I20260620 22:07:37.962173 20968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:37.962606 20974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1221fb70bdad4314b7fc305f2dc93166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1221fb70bdad4314b7fc305f2dc93166" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46301 } } }
I20260620 22:07:37.962618 20975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1221fb70bdad4314b7fc305f2dc93166. Latest consensus state: current_term: 1 leader_uuid: "1221fb70bdad4314b7fc305f2dc93166" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1221fb70bdad4314b7fc305f2dc93166" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 46301 } } }
I20260620 22:07:37.962793 20974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:37.962823 20975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166 [sys.catalog]: This master's current role is: LEADER
W20260620 22:07:37.964198 20989 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:07:37.964252 20989 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:07:37.964475 20977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:37.964646 20977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:37.965714 20972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:37.959516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32826 (local address 127.1.55.254:46301)
0620 22:07:37.959718 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:37.959726 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:37.959756 (+ 30us) server_negotiation.cc:407] Connection header received
0620 22:07:37.960392 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:37.960401 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:37.960473 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:37.960638 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:37.960884 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.962539 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.963636 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:37.964189 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:37.964314 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:37.964962 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:37.964965 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:37.964966 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:37.965183 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:37.965224 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:37.965236 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:37.965314 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:37.965427 (+ 113us) server_negotiation.cc:299] Negotiation successful
0620 22:07:37.965523 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
I20260620 22:07:37.966249 20977 catalog_manager.cc:1347] Generated new cluster ID: 16c0125071ef4ebfb662f8d8277534d5
I20260620 22:07:37.966302 20977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:37.976599 20977 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:37.977245 20977 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:37.983700 20977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166: Generated new TSK 0
I20260620 22:07:37.983841 20977 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:37.988139 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.193:0
--local_ip_for_outbound_sockets=127.1.55.193
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46301
--builtin_ntp_servers=127.1.55.212:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:38.067715 20992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:38.067992 20992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:38.068027 20992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:38.069196 20992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:38.069248 20992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:38.069291 20992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.193
I20260620 22:07:38.070660 20992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.55.193
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.193
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:38.070897 20992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:38.071203 20992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:38.076927 20997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:38.076968 20998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:38.077135 21000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:38.077237 20992 server_base.cc:1034] running on GCE node
I20260620 22:07:38.077432 20992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:38.077744 20992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:38.078905 20992 hybrid_clock.cc:648] HybridClock initialized: now 1781993258078895 us; error 26 us; skew 500 ppm
I20260620 22:07:38.080175 20992 webserver.cc:460] Webserver started at http://127.1.55.193:32805/ using document root <none> and password file <none>
I20260620 22:07:38.080415 20992 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:38.080482 20992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:38.080626 20992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:38.081758 20992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/data/instance:
uuid: "76e413c85ac946f893c2f61c686dc4e9"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "b13dd1c3089f7bc3c4fbca1a09c986af"
server_key_iv: "3b16f3b2ec6fda2238480b1cec1d55ca"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.082123 20992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance:
uuid: "76e413c85ac946f893c2f61c686dc4e9"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "b13dd1c3089f7bc3c4fbca1a09c986af"
server_key_iv: "3b16f3b2ec6fda2238480b1cec1d55ca"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.083403 20992 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:38.084141 21006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.084286 20992 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:38.084364 20992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/wal
uuid: "76e413c85ac946f893c2f61c686dc4e9"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "b13dd1c3089f7bc3c4fbca1a09c986af"
server_key_iv: "3b16f3b2ec6fda2238480b1cec1d55ca"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.084429 20992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:38.096683 20992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:38.096953 20992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:38.097096 20992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:38.097303 20992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:38.097668 20992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:38.097700 20992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.097749 20992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:38.097774 20992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.103520 20992 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.193:34355
I20260620 22:07:38.103572 21119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.193:34355 every 8 connection(s)
I20260620 22:07:38.103840 20992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/data/info.pb
I20260620 22:07:38.108470 20972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.104516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.193:38993 (local address 127.1.55.254:46301)
0620 22:07:38.104591 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.104593 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.104761 (+ 168us) server_negotiation.cc:407] Connection header received
0620 22:07:38.105185 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.105186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.105198 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.105259 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:38.105882 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.106372 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.107267 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.107442 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.107489 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.108278 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:38.108279 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:38.108279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:38.108283 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:38.108292 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:38.108295 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:38.108332 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.108398 (+ 66us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.108417 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260620 22:07:38.108693 21122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.104481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46301 (local address 127.1.55.193:38993)
0620 22:07:38.104653 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.104683 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:38.105111 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:38.105313 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:38.105316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:38.105323 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:38.105816 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.105819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.106453 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.106454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.107198 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.107199 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.107512 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.107513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.107612 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.108164 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:38.108165 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:38.108190 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:38.108211 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:38.108332 (+ 121us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:38.108334 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:38.108343 (+ 9us) client_negotiation.cc:769] Sending connection context
0620 22:07:38.108387 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 22:07:38.108455 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":96,"threads_started":1}
I20260620 22:07:38.109170 21120 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46301
I20260620 22:07:38.109272 21120 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:38.109459 21120 heartbeater.cc:511] Master 127.1.55.254:46301 requested a full tablet report, sending...
I20260620 22:07:38.109941 20932 ts_manager.cc:194] Registered new tserver with Master: 76e413c85ac946f893c2f61c686dc4e9 (127.1.55.193:34355)
I20260620 22:07:38.110512 20932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.193:38993
I20260620 22:07:38.113095 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 20992
I20260620 22:07:38.113173 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-0/wal/instance
I20260620 22:07:38.113306 1247 external_mini_cluster.cc:1428] Setting key 9b17fbe922b551e9eed1e03023e3ac85
I20260620 22:07:38.114091 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.194:0
--local_ip_for_outbound_sockets=127.1.55.194
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46301
--builtin_ntp_servers=127.1.55.212:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260620 22:07:38.190382 21123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:38.190558 21123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:38.190578 21123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:38.191763 21123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:38.191803 21123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:38.191828 21123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.194
I20260620 22:07:38.193151 21123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.55.194
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.194
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:38.193372 21123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:38.193662 21123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:38.198416 21131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:38.198444 21128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:38.198583 21123 server_base.cc:1034] running on GCE node
W20260620 22:07:38.198419 21129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:38.198819 21123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:38.199286 21123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:38.200482 21123 hybrid_clock.cc:648] HybridClock initialized: now 1781993258200457 us; error 36 us; skew 500 ppm
I20260620 22:07:38.201843 21123 webserver.cc:460] Webserver started at http://127.1.55.194:39327/ using document root <none> and password file <none>
I20260620 22:07:38.202088 21123 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:38.202134 21123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:38.202298 21123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:38.203250 21123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/data/instance:
uuid: "532a7b1be0ab4b21b207ce1c71578e7f"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "1f6cae5d6653a67efdd017d234692331"
server_key_iv: "2bd243b4750aa9813673d44c07f4ba25"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.203655 21123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance:
uuid: "532a7b1be0ab4b21b207ce1c71578e7f"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "1f6cae5d6653a67efdd017d234692331"
server_key_iv: "2bd243b4750aa9813673d44c07f4ba25"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.204922 21123 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:38.205648 21137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.205837 21123 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:38.205909 21123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/wal
uuid: "532a7b1be0ab4b21b207ce1c71578e7f"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "1f6cae5d6653a67efdd017d234692331"
server_key_iv: "2bd243b4750aa9813673d44c07f4ba25"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.205997 21123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:38.218004 21123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:38.218268 21123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:38.218416 21123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:38.218628 21123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:38.218943 21123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:38.218995 21123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.219034 21123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:38.219062 21123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.224466 21123 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.194:33977
I20260620 22:07:38.224531 21250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.194:33977 every 8 connection(s)
I20260620 22:07:38.224834 21123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/data/info.pb
I20260620 22:07:38.228282 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 21123
I20260620 22:07:38.228401 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/wal/instance
I20260620 22:07:38.228603 1247 external_mini_cluster.cc:1428] Setting key 354684774c798c54d7fa3df81e43091b
I20260620 22:07:38.229537 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.55.195:0
--local_ip_for_outbound_sockets=127.1.55.195
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46301
--builtin_ntp_servers=127.1.55.212:40501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260620 22:07:38.230026 20972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.225499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.194:58611 (local address 127.1.55.254:46301)
0620 22:07:38.225538 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.225540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.225782 (+ 242us) server_negotiation.cc:407] Connection header received
0620 22:07:38.226261 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.226263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.226293 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.226335 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:38.226979 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.227478 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.228493 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.228802 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.228914 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.229699 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:38.229700 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:38.229701 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:38.229705 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:38.229720 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:38.229724 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:38.229751 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.229949 (+ 198us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.229970 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:07:38.230203 21253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.225455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46301 (local address 127.1.55.194:58611)
0620 22:07:38.225674 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.225702 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:38.226141 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:38.226414 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:38.226423 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:38.226431 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:38.226878 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.226882 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.227585 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.227586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.228398 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.228401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.228912 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.228913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.229064 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.229529 (+ 465us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:38.229529 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:38.229563 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:38.229591 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:38.229787 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:38.229792 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:38.229794 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:07:38.229857 (+ 63us) client_negotiation.cc:240] Negotiation successful
0620 22:07:38.229965 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":122,"threads_started":1}
I20260620 22:07:38.230604 21251 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46301
I20260620 22:07:38.230705 21251 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:38.230952 21251 heartbeater.cc:511] Master 127.1.55.254:46301 requested a full tablet report, sending...
I20260620 22:07:38.231312 20932 ts_manager.cc:194] Registered new tserver with Master: 532a7b1be0ab4b21b207ce1c71578e7f (127.1.55.194:33977)
I20260620 22:07:38.231667 20932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.194:58611
W20260620 22:07:38.307461 21254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:38.307659 21254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:38.307693 21254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:38.308858 21254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:38.308918 21254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:38.308974 21254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.55.195
I20260620 22:07:38.310364 21254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.55.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.55.195
--webserver_port=0
--tserver_master_addrs=127.1.55.254:46301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.55.195
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:38.310606 21254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:38.310873 21254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:38.315654 21259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:38.315668 21254 server_base.cc:1034] running on GCE node
W20260620 22:07:38.315655 21262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:38.315670 21260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:38.316099 21254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:38.316347 21254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:38.317523 21254 hybrid_clock.cc:648] HybridClock initialized: now 1781993258317508 us; error 29 us; skew 500 ppm
I20260620 22:07:38.318729 21254 webserver.cc:460] Webserver started at http://127.1.55.195:39383/ using document root <none> and password file <none>
I20260620 22:07:38.318967 21254 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:38.319011 21254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:38.319168 21254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:38.320135 21254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/data/instance:
uuid: "52484698a5f24a19821f001c9688731b"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "13a30c7fbcc0e788941903cad3b4f55d"
server_key_iv: "b45d30326c81f1b4c457d5071c0a61e3"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.320454 21254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance:
uuid: "52484698a5f24a19821f001c9688731b"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "13a30c7fbcc0e788941903cad3b4f55d"
server_key_iv: "b45d30326c81f1b4c457d5071c0a61e3"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.321648 21254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:38.322278 21268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.322439 21254 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:38.322528 21254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/wal
uuid: "52484698a5f24a19821f001c9688731b"
format_stamp: "Formatted at 2026-06-20 22:07:38 on dist-test-slave-xw35"
server_key: "13a30c7fbcc0e788941903cad3b4f55d"
server_key_iv: "b45d30326c81f1b4c457d5071c0a61e3"
server_key_version: "encryptionkey@0"
I20260620 22:07:38.322603 21254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:38.340237 21254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:38.340497 21254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:38.340641 21254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:38.340842 21254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 22:07:38.341138 21254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 22:07:38.341197 21254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.341235 21254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 22:07:38.341262 21254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:38.346856 21254 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.195:41939
I20260620 22:07:38.346889 21381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.195:41939 every 8 connection(s)
I20260620 22:07:38.347190 21254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/data/info.pb
I20260620 22:07:38.351864 20972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.347865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:45743 (local address 127.1.55.254:46301)
0620 22:07:38.347931 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.347933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.348165 (+ 232us) server_negotiation.cc:407] Connection header received
0620 22:07:38.348607 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.348609 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.348620 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.348685 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:38.349282 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.349814 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.350686 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.350853 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.350908 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.351683 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:38.351684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:38.351684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:38.351687 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:38.351696 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:38.351699 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:38.351736 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.351795 (+ 59us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.351811 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 22:07:38.352085 21384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.347863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:46301 (local address 127.1.55.195:45743)
0620 22:07:38.348056 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.348085 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:38.348523 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:38.348733 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:38.348736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:38.348743 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:07:38.349213 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.349217 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.349900 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.349901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.350618 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.350620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.350922 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.350922 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.351027 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.351567 (+ 540us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0620 22:07:38.351568 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:07:38.351594 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0620 22:07:38.351615 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:07:38.351736 (+ 121us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:07:38.351738 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:07:38.351741 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:38.351785 (+ 44us) client_negotiation.cc:240] Negotiation successful
0620 22:07:38.351858 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":102,"threads_started":1}
I20260620 22:07:38.352521 21382 heartbeater.cc:347] Connected to a master server at 127.1.55.254:46301
I20260620 22:07:38.352627 21382 heartbeater.cc:464] Registering TS with master...
I20260620 22:07:38.352747 21382 heartbeater.cc:511] Master 127.1.55.254:46301 requested a full tablet report, sending...
I20260620 22:07:38.353094 20932 ts_manager.cc:194] Registered new tserver with Master: 52484698a5f24a19821f001c9688731b (127.1.55.195:41939)
I20260620 22:07:38.353394 20932 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.55.195:45743
I20260620 22:07:38.354398 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 21254
I20260620 22:07:38.354477 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/wal/instance
I20260620 22:07:38.354614 1247 external_mini_cluster.cc:1428] Setting key 3989265596eacda2be3329e0f99edf77
I20260620 22:07:38.355381 1247 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 22:07:38.359407 20972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.356661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32838 (local address 127.1.55.254:46301)
0620 22:07:38.356712 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.356714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.356833 (+ 119us) server_negotiation.cc:407] Connection header received
0620 22:07:38.356919 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.356920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.356930 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.356984 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:38.357141 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.357647 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.358362 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.358561 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.358642 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.359187 (+ 545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:38.359189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:38.359189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:38.359193 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:38.359204 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:38.359208 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:38.359261 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.359313 (+ 52us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.359331 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260620 22:07:38.360663 20932 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 22:07:38.362365 20932 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 22:07:38.368592 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.364691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:33977 (local address 127.0.0.1:37356)
0620 22:07:38.365208 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.365218 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:38.365273 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:38.365461 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:38.365461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:38.365463 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:38.365516 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.365518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.366328 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.366330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.367584 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.367587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.368299 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.368300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.368373 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.368385 (+ 12us) client_negotiation.cc:769] Sending connection context
0620 22:07:38.368461 (+ 76us) client_negotiation.cc:240] Negotiation successful
0620 22:07:38.368511 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":2,"thread_start_us":55,"threads_started":1}
I20260620 22:07:38.368677 21393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.364651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47572 (local address 127.1.55.195:41939)
0620 22:07:38.364976 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.364979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.365005 (+ 26us) server_negotiation.cc:407] Connection header received
0620 22:07:38.365038 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.365040 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.365054 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.365130 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:38.365351 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.366432 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.367673 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.368376 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.368439 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.368506 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.368559 (+ 53us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.368598 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":79,"threads_started":1}
I20260620 22:07:38.368865 21390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.364492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.195:41939 (local address 127.0.0.1:47572)
0620 22:07:38.364616 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.364655 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:38.364718 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:38.365218 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:38.365231 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:38.365233 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:38.365274 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.365275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.366517 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.366518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.367590 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.367592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.368438 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.368439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.368494 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.368496 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:07:38.368548 (+ 52us) client_negotiation.cc:240] Negotiation successful
0620 22:07:38.368581 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"spinlock_wait_cycles":768,"thread_start_us":78,"threads_started":1}
I20260620 22:07:38.368919 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.364896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37356 (local address 127.1.55.194:33977)
0620 22:07:38.365070 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.365076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.365324 (+ 248us) server_negotiation.cc:407] Connection header received
0620 22:07:38.365363 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.365365 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.365380 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.365464 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:38.365572 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.366214 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.367687 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.368193 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.368294 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.368382 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.368790 (+ 408us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.368833 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260620 22:07:38.368976 21392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.364590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52512 (local address 127.1.55.193:34355)
0620 22:07:38.364816 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.364819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.364866 (+ 47us) server_negotiation.cc:407] Connection header received
0620 22:07:38.364948 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.364950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.364967 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.365045 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:38.365299 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.366445 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.367532 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.368306 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.368381 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.368467 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.368832 (+ 365us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.368869 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":81,"threads_started":1}
I20260620 22:07:38.369184 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.364492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:34355 (local address 127.0.0.1:52512)
0620 22:07:38.364810 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.364821 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:38.364877 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:38.365147 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:38.365149 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:38.365152 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:38.365212 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.365214 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.366532 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.366533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.367447 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.367449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.368504 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.368506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.368570 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.368574 (+ 4us) client_negotiation.cc:769] Sending connection context
0620 22:07:38.368624 (+ 50us) client_negotiation.cc:240] Negotiation successful
0620 22:07:38.369081 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":6,"thread_start_us":63,"threads_started":1}
I20260620 22:07:38.369567 21316 tablet_service.cc:1467] Processing CreateTablet for tablet 04ecfe47afce401cab1c1cd9a9d9f528 (DEFAULT_TABLE table=test-table [id=932941f5364b41b4bb18e8d198cd180f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:38.369899 21316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04ecfe47afce401cab1c1cd9a9d9f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:38.372193 21396 tablet_bootstrap.cc:492] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: Bootstrap starting.
I20260620 22:07:38.372505 21185 tablet_service.cc:1467] Processing CreateTablet for tablet 04ecfe47afce401cab1c1cd9a9d9f528 (DEFAULT_TABLE table=test-table [id=932941f5364b41b4bb18e8d198cd180f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:38.372824 21185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04ecfe47afce401cab1c1cd9a9d9f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:38.372851 21396 tablet_bootstrap.cc:654] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:38.373139 21396 log.cc:824] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:38.373971 21396 tablet_bootstrap.cc:492] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: No bootstrap required, opened a new log
I20260620 22:07:38.374038 21396 ts_tablet_manager.cc:1397] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:38.374164 21054 tablet_service.cc:1467] Processing CreateTablet for tablet 04ecfe47afce401cab1c1cd9a9d9f528 (DEFAULT_TABLE table=test-table [id=932941f5364b41b4bb18e8d198cd180f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 22:07:38.374466 21054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04ecfe47afce401cab1c1cd9a9d9f528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:38.375481 21398 tablet_bootstrap.cc:492] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Bootstrap starting.
I20260620 22:07:38.376030 21398 tablet_bootstrap.cc:654] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:38.376340 21398 log.cc:824] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:38.376467 21396 raft_consensus.cc:348] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.376641 21396 raft_consensus.cc:374] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:38.376688 21396 raft_consensus.cc:729] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52484698a5f24a19821f001c9688731b, State: Initialized, Role: FOLLOWER
I20260620 22:07:38.376814 21396 consensus_queue.cc:260] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.377045 21398 tablet_bootstrap.cc:492] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: No bootstrap required, opened a new log
I20260620 22:07:38.377058 21396 ts_tablet_manager.cc:1428] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:07:38.377177 21382 heartbeater.cc:503] Master 127.1.55.254:46301 was elected leader, sending a full tablet report...
I20260620 22:07:38.377128 21398 ts_tablet_manager.cc:1397] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:38.377658 21401 tablet_bootstrap.cc:492] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9: Bootstrap starting.
I20260620 22:07:38.378294 21401 tablet_bootstrap.cc:654] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:38.378654 21401 log.cc:824] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:38.379304 21401 tablet_bootstrap.cc:492] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9: No bootstrap required, opened a new log
I20260620 22:07:38.379395 21401 ts_tablet_manager.cc:1397] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260620 22:07:38.379575 21398 raft_consensus.cc:348] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.379715 21398 raft_consensus.cc:374] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:38.379734 21398 raft_consensus.cc:729] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 532a7b1be0ab4b21b207ce1c71578e7f, State: Initialized, Role: FOLLOWER
I20260620 22:07:38.379833 21398 consensus_queue.cc:260] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.380098 21398 ts_tablet_manager.cc:1428] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:07:38.380152 21251 heartbeater.cc:503] Master 127.1.55.254:46301 was elected leader, sending a full tablet report...
I20260620 22:07:38.381672 21401 raft_consensus.cc:348] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.381783 21401 raft_consensus.cc:374] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:38.381803 21401 raft_consensus.cc:729] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76e413c85ac946f893c2f61c686dc4e9, State: Initialized, Role: FOLLOWER
I20260620 22:07:38.381867 21401 consensus_queue.cc:260] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.382072 21401 ts_tablet_manager.cc:1428] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 22:07:38.382115 21120 heartbeater.cc:503] Master 127.1.55.254:46301 was elected leader, sending a full tablet report...
W20260620 22:07:38.475347 21252 tablet.cc:2369] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 22:07:38.515287 21400 raft_consensus.cc:482] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 22:07:38.515393 21400 raft_consensus.cc:504] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.515704 21400 leader_election.cc:288] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76e413c85ac946f893c2f61c686dc4e9 (127.1.55.193:34355), 532a7b1be0ab4b21b207ce1c71578e7f (127.1.55.194:33977)
I20260620 22:07:38.519556 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.515945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:53329 (local address 127.1.55.194:33977)
0620 22:07:38.515993 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.515995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.516005 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:07:38.516081 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.516082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.516098 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.516169 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:38.516369 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.517131 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.518693 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.519212 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.519283 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.519289 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.519458 (+ 169us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.519492 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260620 22:07:38.519556 21392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.515973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.55.195:42507 (local address 127.1.55.193:34355)
0620 22:07:38.516017 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.516019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.516156 (+ 137us) server_negotiation.cc:407] Connection header received
0620 22:07:38.516221 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.516222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.516235 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.516277 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 22:07:38.516447 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.517129 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.518694 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.519212 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.519283 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.519289 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.519458 (+ 169us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.519492 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260620 22:07:38.519575 21384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.515881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.194:33977 (local address 127.1.55.195:53329)
0620 22:07:38.515956 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.515967 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:38.516007 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:38.516195 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:38.516196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:38.516198 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:38.516297 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.516299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.517224 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.517225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.518606 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.518609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.519291 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.519292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.519382 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.519385 (+ 3us) client_negotiation.cc:769] Sending connection context
0620 22:07:38.519440 (+ 55us) client_negotiation.cc:240] Negotiation successful
0620 22:07:38.519490 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":98}
I20260620 22:07:38.519582 21405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.515904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:34355 (local address 127.1.55.195:42507)
0620 22:07:38.516079 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.516087 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:07:38.516140 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:07:38.516299 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:07:38.516300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:07:38.516301 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0620 22:07:38.516373 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.516374 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.517224 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.517225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.518606 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:07:38.518609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.519291 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.519292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:07:38.519383 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.519385 (+ 2us) client_negotiation.cc:769] Sending connection context
0620 22:07:38.519440 (+ 55us) client_negotiation.cc:240] Negotiation successful
0620 22:07:38.519487 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":53,"thread_start_us":99,"threads_started":1}
I20260620 22:07:38.519989 21205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04ecfe47afce401cab1c1cd9a9d9f528" candidate_uuid: "52484698a5f24a19821f001c9688731b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" is_pre_election: true
I20260620 22:07:38.520167 21205 raft_consensus.cc:2454] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52484698a5f24a19821f001c9688731b in term 0.
I20260620 22:07:38.520140 21074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04ecfe47afce401cab1c1cd9a9d9f528" candidate_uuid: "52484698a5f24a19821f001c9688731b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76e413c85ac946f893c2f61c686dc4e9" is_pre_election: true
I20260620 22:07:38.520278 21074 raft_consensus.cc:2454] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52484698a5f24a19821f001c9688731b in term 0.
I20260620 22:07:38.520395 21270 leader_election.cc:302] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52484698a5f24a19821f001c9688731b, 532a7b1be0ab4b21b207ce1c71578e7f; no voters:
I20260620 22:07:38.520545 21400 raft_consensus.cc:2781] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 22:07:38.520593 21400 raft_consensus.cc:482] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 22:07:38.520620 21400 raft_consensus.cc:3037] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:38.521234 21400 raft_consensus.cc:504] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.521353 21400 leader_election.cc:288] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [CANDIDATE]: Term 1 election: Requested vote from peers 76e413c85ac946f893c2f61c686dc4e9 (127.1.55.193:34355), 532a7b1be0ab4b21b207ce1c71578e7f (127.1.55.194:33977)
I20260620 22:07:38.521533 21074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04ecfe47afce401cab1c1cd9a9d9f528" candidate_uuid: "52484698a5f24a19821f001c9688731b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76e413c85ac946f893c2f61c686dc4e9"
I20260620 22:07:38.521541 21205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04ecfe47afce401cab1c1cd9a9d9f528" candidate_uuid: "52484698a5f24a19821f001c9688731b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "532a7b1be0ab4b21b207ce1c71578e7f"
I20260620 22:07:38.521605 21205 raft_consensus.cc:3037] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:38.521624 21074 raft_consensus.cc:3037] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:38.522282 21205 raft_consensus.cc:2454] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52484698a5f24a19821f001c9688731b in term 1.
I20260620 22:07:38.522363 21074 raft_consensus.cc:2454] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52484698a5f24a19821f001c9688731b in term 1.
I20260620 22:07:38.522426 21270 leader_election.cc:302] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52484698a5f24a19821f001c9688731b, 532a7b1be0ab4b21b207ce1c71578e7f; no voters:
I20260620 22:07:38.522500 21400 raft_consensus.cc:2781] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:38.522609 21400 raft_consensus.cc:686] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 1 LEADER]: Becoming Leader. State: Replica: 52484698a5f24a19821f001c9688731b, State: Running, Role: LEADER
I20260620 22:07:38.522701 21400 consensus_queue.cc:237] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } }
I20260620 22:07:38.523491 20931 catalog_manager.cc:5495] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b reported cstate change: term changed from 0 to 1, leader changed from <none> to 52484698a5f24a19821f001c9688731b (127.1.55.195). New cstate: current_term: 1 leader_uuid: "52484698a5f24a19821f001c9688731b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52484698a5f24a19821f001c9688731b" member_type: VOTER last_known_addr { host: "127.1.55.195" port: 41939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 } health_report { overall_health: UNKNOWN } } }
I20260620 22:07:38.549686 21393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.547332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47582 (local address 127.1.55.195:41939)
0620 22:07:38.547381 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:38.547383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:38.547392 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:07:38.547478 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:38.547479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:38.547501 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:38.547578 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:07:38.547684 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.548137 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.548890 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:38.549077 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:38.549147 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:38.549305 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:07:38.549404 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:07:38.549549 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:38.549569 (+ 20us) server_negotiation.cc:299] Negotiation successful
0620 22:07:38.549588 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260620 22:07:38.551290 21205 raft_consensus.cc:1261] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 1 FOLLOWER]: Refusing update from remote peer 52484698a5f24a19821f001c9688731b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:38.551292 21074 raft_consensus.cc:1261] T 04ecfe47afce401cab1c1cd9a9d9f528 P 76e413c85ac946f893c2f61c686dc4e9 [term 1 FOLLOWER]: Refusing update from remote peer 52484698a5f24a19821f001c9688731b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:07:38.551640 21406 consensus_queue.cc:1035] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [LEADER]: Connected to new peer: Peer: permanent_uuid: "532a7b1be0ab4b21b207ce1c71578e7f" member_type: VOTER last_known_addr { host: "127.1.55.194" port: 33977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:38.551774 21400 consensus_queue.cc:1035] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [LEADER]: Connected to new peer: Peer: permanent_uuid: "76e413c85ac946f893c2f61c686dc4e9" member_type: VOTER last_known_addr { host: "127.1.55.193" port: 34355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:07:38.554695 21411 mvcc.cc:205] Tried to move back new op lower bound from 7299044387023851520 to 7299044386909605888. Current Snapshot: MvccSnapshot[applied={T|T < 7299044387023851520 or (T in {7299044387023851520})}]
I20260620 22:07:38.555202 21410 mvcc.cc:205] Tried to move back new op lower bound from 7299044387023851520 to 7299044386909605888. Current Snapshot: MvccSnapshot[applied={T|T < 7299044387023851520 or (T in {7299044387023851520})}]
I20260620 22:07:38.556165 20931 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:38.556281 20931 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260620 22:07:38.556957 20931 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1221fb70bdad4314b7fc305f2dc93166: Sending DeleteTablet for 3 replicas of tablet 04ecfe47afce401cab1c1cd9a9d9f528
I20260620 22:07:38.557263 21316 tablet_service.cc:1514] Processing DeleteTablet for tablet 04ecfe47afce401cab1c1cd9a9d9f528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:38 UTC) from {username='slave'} at 127.0.0.1:47572
I20260620 22:07:38.557312 21054 tablet_service.cc:1514] Processing DeleteTablet for tablet 04ecfe47afce401cab1c1cd9a9d9f528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:38 UTC) from {username='slave'} at 127.0.0.1:52512
I20260620 22:07:38.557358 21185 tablet_service.cc:1514] Processing DeleteTablet for tablet 04ecfe47afce401cab1c1cd9a9d9f528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 22:07:38 UTC) from {username='slave'} at 127.0.0.1:37356
I20260620 22:07:38.557502 21418 tablet_replica.cc:330] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: stopping tablet replica
I20260620 22:07:38.557580 21418 raft_consensus.cc:2229] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 1 LEADER]: Raft consensus shutting down.
I20260620 22:07:38.557658 21418 raft_consensus.cc:2258] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:38.557768 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 20992
I20260620 22:07:38.558660 21418 ts_tablet_manager.cc:1905] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:38.560243 21418 ts_tablet_manager.cc:1918] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:38.560314 21418 log.cc:1196] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-2/wal/wals/04ecfe47afce401cab1c1cd9a9d9f528
I20260620 22:07:38.560412 21420 tablet_replica.cc:330] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: stopping tablet replica
I20260620 22:07:38.560511 21420 raft_consensus.cc:2229] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 22:07:38.560570 21418 ts_tablet_manager.cc:1939] T 04ecfe47afce401cab1c1cd9a9d9f528 P 52484698a5f24a19821f001c9688731b: Deleting consensus metadata
I20260620 22:07:38.560608 21420 raft_consensus.cc:2258] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 22:07:38.560985 20917 catalog_manager.cc:4841] TS 52484698a5f24a19821f001c9688731b (127.1.55.195:41939): tablet 04ecfe47afce401cab1c1cd9a9d9f528 (table test-table [id=932941f5364b41b4bb18e8d198cd180f]) successfully deleted
I20260620 22:07:38.561229 21420 ts_tablet_manager.cc:1905] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 22:07:38.562752 21420 ts_tablet_manager.cc:1918] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 22:07:38.562831 21420 log.cc:1196] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Deleting WAL directory at /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781993001979103-1247-0/minicluster-data/ts-1/wal/wals/04ecfe47afce401cab1c1cd9a9d9f528
I20260620 22:07:38.563081 21420 ts_tablet_manager.cc:1939] T 04ecfe47afce401cab1c1cd9a9d9f528 P 532a7b1be0ab4b21b207ce1c71578e7f: Deleting consensus metadata
I20260620 22:07:38.563433 20917 catalog_manager.cc:4841] TS 532a7b1be0ab4b21b207ce1c71578e7f (127.1.55.194:33977): tablet 04ecfe47afce401cab1c1cd9a9d9f528 (table test-table [id=932941f5364b41b4bb18e8d198cd180f]) successfully deleted
W20260620 22:07:38.564149 20918 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.55.193:34355 (error 108)
I20260620 22:07:38.564365 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 21123
I20260620 22:07:38.564906 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:38.564442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.193:34355 (local address 127.0.0.1:52520)
0620 22:07:38.564828 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0620 22:07:38.564872 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.193:34355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364}
W20260620 22:07:38.565161 20918 catalog_manager.cc:4584] TS 76e413c85ac946f893c2f61c686dc4e9 (127.1.55.193:34355): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 04ecfe47afce401cab1c1cd9a9d9f528: Network error: Client connection negotiation failed: client connection to 127.1.55.193:34355: connect: Connection refused (error 111)
I20260620 22:07:38.569329 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 21254
I20260620 22:07:38.573684 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 20901
2026-06-20T22:07:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (753 ms)
[----------] 6 tests from EncryptionPolicyTest (7776 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:38 dist-test-slave-xw35 krb5kdc[21424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:38 dist-test-slave-xw35 krb5kdc[21424](info): set up 2 sockets
Jun 20 22:07:38 dist-test-slave-xw35 krb5kdc[21424](info): commencing operation
krb5kdc: starting...
W20260620 22:07:39.589349 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.997s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:39 dist-test-slave-xw35 krb5kdc[21424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:39.695845 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45665
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:39.772725 21437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:39.772930 21437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:39.772953 21437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:39.774111 21437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:39.774149 21437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:39.774163 21437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:39.774176 21437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:39.774188 21437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:39.775519 21437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45665
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:39.775681 21437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:39.775832 21437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:07:39.780588 21437 server_base.cc:1034] running on GCE node
W20260620 22:07:39.780568 21443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:39.780560 21445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:39.780560 21442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:39.781098 21437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:39.781318 21437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:39.782455 21437 hybrid_clock.cc:648] HybridClock initialized: now 1781993259782438 us; error 34 us; skew 500 ppm
Jun 20 22:07:39 dist-test-slave-xw35 krb5kdc[21424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993259, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:39.784849 21437 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:39.785274 21437 webserver.cc:460] Webserver started at http://127.0.0.1:37995/ using document root <none> and password file <none>
I20260620 22:07:39.785547 21437 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:39.785593 21437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:39.785730 21437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:39.786716 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "aec258619e0f425d8756800a45e01578"
format_stamp: "Formatted at 2026-06-20 22:07:39 on dist-test-slave-xw35"
server_key: "d19e56976ea6aacace8aa1671d54d839"
server_key_iv: "30af0193f5b1d95abbf53a68589f8b0f"
server_key_version: "encryptionkey@0"
I20260620 22:07:39.787057 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "aec258619e0f425d8756800a45e01578"
format_stamp: "Formatted at 2026-06-20 22:07:39 on dist-test-slave-xw35"
server_key: "d19e56976ea6aacace8aa1671d54d839"
server_key_iv: "30af0193f5b1d95abbf53a68589f8b0f"
server_key_version: "encryptionkey@0"
I20260620 22:07:39.788360 21437 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:07:39.789099 21452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:39.789264 21437 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:39.789361 21437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "aec258619e0f425d8756800a45e01578"
format_stamp: "Formatted at 2026-06-20 22:07:39 on dist-test-slave-xw35"
server_key: "d19e56976ea6aacace8aa1671d54d839"
server_key_iv: "30af0193f5b1d95abbf53a68589f8b0f"
server_key_version: "encryptionkey@0"
I20260620 22:07:39.789434 21437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:39.804246 21437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:39.806416 21437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:39.806569 21437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:39.810540 21437 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45665
I20260620 22:07:39.810590 21504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45665 every 8 connection(s)
I20260620 22:07:39.810899 21437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:39.811772 21505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:39.814034 21505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578: Bootstrap starting.
I20260620 22:07:39.814577 21505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:39.814837 21505 log.cc:824] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:39.815480 21505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578: No bootstrap required, opened a new log
I20260620 22:07:39.816990 21505 raft_consensus.cc:348] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec258619e0f425d8756800a45e01578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } }
I20260620 22:07:39.817117 21505 raft_consensus.cc:374] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:39.817142 21505 raft_consensus.cc:729] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aec258619e0f425d8756800a45e01578, State: Initialized, Role: FOLLOWER
I20260620 22:07:39.817301 21505 consensus_queue.cc:260] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec258619e0f425d8756800a45e01578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } }
I20260620 22:07:39.817384 21505 raft_consensus.cc:388] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:39.817406 21505 raft_consensus.cc:482] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:39.817497 21505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:39.817992 21505 raft_consensus.cc:504] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec258619e0f425d8756800a45e01578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } }
I20260620 22:07:39.818095 21505 leader_election.cc:302] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aec258619e0f425d8756800a45e01578; no voters:
I20260620 22:07:39.818260 21505 leader_election.cc:288] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:39.818290 21508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:39.818441 21508 raft_consensus.cc:686] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [term 1 LEADER]: Becoming Leader. State: Replica: aec258619e0f425d8756800a45e01578, State: Running, Role: LEADER
I20260620 22:07:39.818504 21505 sys_catalog.cc:564] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:39.818522 21508 consensus_queue.cc:237] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec258619e0f425d8756800a45e01578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } }
I20260620 22:07:39.818897 21509 sys_catalog.cc:455] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aec258619e0f425d8756800a45e01578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec258619e0f425d8756800a45e01578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } } }
I20260620 22:07:39.818974 21509 sys_catalog.cc:458] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:39.819010 21510 sys_catalog.cc:455] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aec258619e0f425d8756800a45e01578. Latest consensus state: current_term: 1 leader_uuid: "aec258619e0f425d8756800a45e01578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aec258619e0f425d8756800a45e01578" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } } }
I20260620 22:07:39.819104 21510 sys_catalog.cc:458] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:39.819180 21516 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:39.819671 21516 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:39.819902 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 21437
I20260620 22:07:39.820024 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:39.820215 1247 external_mini_cluster.cc:1428] Setting key fbb47cbd448c80e0e4a08b4d377ef213
I20260620 22:07:39.821214 21516 catalog_manager.cc:1347] Generated new cluster ID: 835768001e4e46a2a890b1823424c448
I20260620 22:07:39.821264 21516 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:07:39 dist-test-slave-xw35 krb5kdc[21424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260620 22:07:39.829425 21528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:39.820757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47181 (local address 127.0.0.1:45665)
0620 22:07:39.820914 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:39.820922 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:39.820955 (+ 33us) server_negotiation.cc:407] Connection header received
0620 22:07:39.821036 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:39.821040 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:39.821082 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:39.821219 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:39.821924 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:39.822718 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:39.823427 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:39.823820 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:39.823965 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:39.826201 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:39.826204 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:39.826204 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:39.826214 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:39.827917 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:39.828304 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:39.828307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:39.828307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:39.828407 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:39.828645 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:39.828646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:39.828647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:39.828874 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:39.829074 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:39.829151 (+ 77us) server_negotiation.cc:299] Negotiation successful
0620 22:07:39.829243 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
I20260620 22:07:39.830338 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:39.834107 21516 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:39.834698 21516 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:39.839589 21516 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aec258619e0f425d8756800a45e01578: Generated new TSK 0
I20260620 22:07:39.839732 21516 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:39.839957 21528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:39.833710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33323 (local address 127.0.0.1:45665)
0620 22:07:39.833740 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:39.833742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:39.833916 (+ 174us) server_negotiation.cc:407] Connection header received
0620 22:07:39.833978 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:39.833979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:39.833988 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:39.834039 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:39.834565 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:39.835031 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:39.835674 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:39.835871 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:39.835939 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:39.837281 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:39.837282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:39.837283 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:39.837289 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:39.838642 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:39.839017 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:39.839019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:39.839019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:39.839072 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:39.839311 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:39.839312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:39.839312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:39.839445 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:39.839565 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:39.839799 (+ 234us) server_negotiation.cc:299] Negotiation successful
0620 22:07:39.839866 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260620 22:07:39.842008 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 21437
W20260620 22:07:39.846942 21422 connection.cc:535] client connection to 127.0.0.1:45665 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45665): Connection reset by peer (error 104)
2026-06-20T22:07:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1267 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:39 dist-test-slave-xw35 krb5kdc[21536](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:39 dist-test-slave-xw35 krb5kdc[21536](info): set up 2 sockets
Jun 20 22:07:39 dist-test-slave-xw35 krb5kdc[21536](info): commencing operation
krb5kdc: starting...
W20260620 22:07:40.853365 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.993s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:40 dist-test-slave-xw35 krb5kdc[21536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:40.960480 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35613
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:41.037086 21549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:41.037320 21549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:41.037357 21549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:41.038514 21549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:41.038581 21549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:41.038605 21549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:41.038632 21549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:41.038662 21549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:41.040091 21549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35613
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:41.040346 21549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:41.040558 21549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:41.045104 21557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:41.045096 21555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:41.045171 21549 server_base.cc:1034] running on GCE node
W20260620 22:07:41.045094 21554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:41.045606 21549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:41.045883 21549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:41.047021 21549 hybrid_clock.cc:648] HybridClock initialized: now 1781993261047012 us; error 27 us; skew 500 ppm
Jun 20 22:07:41 dist-test-slave-xw35 krb5kdc[21536](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993261, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:41.049372 21549 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:41.049784 21549 webserver.cc:460] Webserver started at http://127.0.0.1:44255/ using document root <none> and password file <none>
I20260620 22:07:41.049973 21549 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:41.050015 21549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:41.050100 21549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:41.051003 21549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "acfb5f19bb6142ff8686f44a4578abe5"
format_stamp: "Formatted at 2026-06-20 22:07:41 on dist-test-slave-xw35"
server_key: "551a4e1a2a0ee22e37c331b82b516007"
server_key_iv: "5bd77756dda8076e9ee8a165f7955d6b"
server_key_version: "encryptionkey@0"
I20260620 22:07:41.051296 21549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "acfb5f19bb6142ff8686f44a4578abe5"
format_stamp: "Formatted at 2026-06-20 22:07:41 on dist-test-slave-xw35"
server_key: "551a4e1a2a0ee22e37c331b82b516007"
server_key_iv: "5bd77756dda8076e9ee8a165f7955d6b"
server_key_version: "encryptionkey@0"
I20260620 22:07:41.052380 21549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:41.052963 21564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:41.053129 21549 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:41.053216 21549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "acfb5f19bb6142ff8686f44a4578abe5"
format_stamp: "Formatted at 2026-06-20 22:07:41 on dist-test-slave-xw35"
server_key: "551a4e1a2a0ee22e37c331b82b516007"
server_key_iv: "5bd77756dda8076e9ee8a165f7955d6b"
server_key_version: "encryptionkey@0"
I20260620 22:07:41.053288 21549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:41.061829 21549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:41.063604 21549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:41.063750 21549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:41.067667 21549 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35613
I20260620 22:07:41.067696 21616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35613 every 8 connection(s)
I20260620 22:07:41.068027 21549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:41.068951 21617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:41.071069 21617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5: Bootstrap starting.
I20260620 22:07:41.071607 21617 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:41.071885 21617 log.cc:824] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:41.072481 21617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5: No bootstrap required, opened a new log
I20260620 22:07:41.073930 21617 raft_consensus.cc:348] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acfb5f19bb6142ff8686f44a4578abe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35613 } }
I20260620 22:07:41.074045 21617 raft_consensus.cc:374] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:41.074065 21617 raft_consensus.cc:729] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acfb5f19bb6142ff8686f44a4578abe5, State: Initialized, Role: FOLLOWER
I20260620 22:07:41.074208 21617 consensus_queue.cc:260] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acfb5f19bb6142ff8686f44a4578abe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35613 } }
I20260620 22:07:41.074262 21617 raft_consensus.cc:388] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:41.074303 21617 raft_consensus.cc:482] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:41.074348 21617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:41.074743 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 21549
I20260620 22:07:41.074805 21617 raft_consensus.cc:504] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acfb5f19bb6142ff8686f44a4578abe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35613 } }
I20260620 22:07:41.074870 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:41.074940 21617 leader_election.cc:302] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acfb5f19bb6142ff8686f44a4578abe5; no voters:
I20260620 22:07:41.075069 1247 external_mini_cluster.cc:1428] Setting key 7f3064300024c8041de91b92017b4a2d
I20260620 22:07:41.075104 21617 leader_election.cc:288] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:41.075124 21620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:41.075223 21620 raft_consensus.cc:686] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [term 1 LEADER]: Becoming Leader. State: Replica: acfb5f19bb6142ff8686f44a4578abe5, State: Running, Role: LEADER
I20260620 22:07:41.075340 21617 sys_catalog.cc:564] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:41.075290 21620 consensus_queue.cc:237] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acfb5f19bb6142ff8686f44a4578abe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35613 } }
I20260620 22:07:41.075623 21620 sys_catalog.cc:455] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader acfb5f19bb6142ff8686f44a4578abe5. Latest consensus state: current_term: 1 leader_uuid: "acfb5f19bb6142ff8686f44a4578abe5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acfb5f19bb6142ff8686f44a4578abe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35613 } } }
I20260620 22:07:41.075697 21620 sys_catalog.cc:458] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:41.075763 21621 sys_catalog.cc:455] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acfb5f19bb6142ff8686f44a4578abe5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acfb5f19bb6142ff8686f44a4578abe5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35613 } } }
I20260620 22:07:41.075846 21621 sys_catalog.cc:458] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:41.075971 21628 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:41.076478 21628 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:41.079509 21628 catalog_manager.cc:1347] Generated new cluster ID: 2cbe80aa09654533878bff8ad17ede53
I20260620 22:07:41.079591 21628 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:41.080822 21624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:41.075485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36749 (local address 127.0.0.1:35613)
0620 22:07:41.075955 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:41.075963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:41.076196 (+ 233us) server_negotiation.cc:407] Connection header received
0620 22:07:41.076306 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:41.076312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:41.076364 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:41.076479 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:41.076818 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:41.077888 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:41.078655 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:41.079192 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:41.079335 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:41.080056 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:41.080060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:41.080061 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:41.080256 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:41.080291 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:41.080304 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:41.080549 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:41.080586 (+ 37us) server_negotiation.cc:299] Negotiation successful
0620 22:07:41.080610 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":63,"threads_started":1}
I20260620 22:07:41.081881 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:41.089251 21624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:41.085814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45131 (local address 127.0.0.1:35613)
0620 22:07:41.085853 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:41.085854 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:41.085973 (+ 119us) server_negotiation.cc:407] Connection header received
0620 22:07:41.086020 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:41.086021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:41.086029 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:41.086083 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:41.086236 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:41.086929 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:41.087971 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:41.088285 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:41.088344 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:41.089011 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:41.089012 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:41.089012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:41.089016 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:41.089028 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:41.089032 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:41.089084 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:41.089173 (+ 89us) server_negotiation.cc:299] Negotiation successful
0620 22:07:41.089184 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:07:41.100368 21628 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:41.101022 21628 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:41.109226 21628 catalog_manager.cc:5868] T 00000000000000000000000000000000 P acfb5f19bb6142ff8686f44a4578abe5: Generated new TSK 0
I20260620 22:07:41.109401 21628 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:41.116693 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 21549
W20260620 22:07:41.120684 21534 connection.cc:535] client connection to 127.0.0.1:35613 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35613): Connection reset by peer (error 104)
2026-06-20T22:07:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1273 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:41 dist-test-slave-xw35 krb5kdc[21648](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:41 dist-test-slave-xw35 krb5kdc[21648](info): set up 2 sockets
Jun 20 22:07:41 dist-test-slave-xw35 krb5kdc[21648](info): commencing operation
krb5kdc: starting...
W20260620 22:07:42.137781 1247 mini_kdc.cc:121] Time spent starting KDC: real 1.004s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:42 dist-test-slave-xw35 krb5kdc[21648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:42.245057 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38907
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38907
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:42.320588 21661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:42.320765 21661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:42.320786 21661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:42.321820 21661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:42.321849 21661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:42.321862 21661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:42.321875 21661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:42.321887 21661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:42.323244 21661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38907
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:42.323436 21661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:42.323598 21661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:42.328090 21667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:42.328210 21661 server_base.cc:1034] running on GCE node
W20260620 22:07:42.328119 21669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:42.328109 21666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:42.328560 21661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:42.328847 21661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:42.330009 21661 hybrid_clock.cc:648] HybridClock initialized: now 1781993262329997 us; error 26 us; skew 500 ppm
Jun 20 22:07:42 dist-test-slave-xw35 krb5kdc[21648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993262, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:42.332208 21661 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:42.332607 21661 webserver.cc:460] Webserver started at http://127.0.0.1:45735/ using document root <none> and password file <none>
I20260620 22:07:42.332823 21661 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:42.332894 21661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:42.333035 21661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:42.334082 21661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "7bb005ba381d44348c9493ecd49f37a7"
format_stamp: "Formatted at 2026-06-20 22:07:42 on dist-test-slave-xw35"
server_key: "f797e929158635ff31a9240bcff7b21c"
server_key_iv: "226779cef6f711fe4788e7e38a321241"
server_key_version: "encryptionkey@0"
I20260620 22:07:42.334391 21661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "7bb005ba381d44348c9493ecd49f37a7"
format_stamp: "Formatted at 2026-06-20 22:07:42 on dist-test-slave-xw35"
server_key: "f797e929158635ff31a9240bcff7b21c"
server_key_iv: "226779cef6f711fe4788e7e38a321241"
server_key_version: "encryptionkey@0"
I20260620 22:07:42.335609 21661 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:42.336310 21676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:42.336485 21661 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:42.336588 21661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "7bb005ba381d44348c9493ecd49f37a7"
format_stamp: "Formatted at 2026-06-20 22:07:42 on dist-test-slave-xw35"
server_key: "f797e929158635ff31a9240bcff7b21c"
server_key_iv: "226779cef6f711fe4788e7e38a321241"
server_key_version: "encryptionkey@0"
I20260620 22:07:42.336687 21661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:42.339931 21661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:42.341620 21661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:42.341766 21661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:42.345384 21661 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38907
I20260620 22:07:42.345417 21728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38907 every 8 connection(s)
I20260620 22:07:42.345708 21661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:42.346567 21729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:42.348486 21729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7: Bootstrap starting.
I20260620 22:07:42.348779 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 21661
I20260620 22:07:42.348901 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:42.349016 21729 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:42.349115 1247 external_mini_cluster.cc:1428] Setting key ddbdc3033fac1fd51b830e21e5dd9836
I20260620 22:07:42.349360 21729 log.cc:824] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:42.350119 21729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7: No bootstrap required, opened a new log
I20260620 22:07:42.351547 21733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:42.349584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60059 (local address 127.0.0.1:38907)
0620 22:07:42.349728 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:42.349735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:42.349828 (+ 93us) server_negotiation.cc:407] Connection header received
0620 22:07:42.350448 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:42.350456 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:42.350486 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:42.350619 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:42.351164 (+ 545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:42.351168 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:42.351168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:42.351172 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:42.351209 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:42.351222 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:42.351306 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:42.351336 (+ 30us) server_negotiation.cc:299] Negotiation successful
0620 22:07:42.351370 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":67,"threads_started":1}
I20260620 22:07:42.352489 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:42.352578 21729 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb005ba381d44348c9493ecd49f37a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38907 } }
I20260620 22:07:42.352712 21729 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:42.352741 21729 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bb005ba381d44348c9493ecd49f37a7, State: Initialized, Role: FOLLOWER
I20260620 22:07:42.352838 21729 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb005ba381d44348c9493ecd49f37a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38907 } }
I20260620 22:07:42.352916 21729 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:42.352946 21729 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:42.352993 21729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:42.353684 21729 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb005ba381d44348c9493ecd49f37a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38907 } }
I20260620 22:07:42.353801 21729 leader_election.cc:302] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bb005ba381d44348c9493ecd49f37a7; no voters:
I20260620 22:07:42.353950 21729 leader_election.cc:288] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:42.353977 21738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:42.354192 21738 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [term 1 LEADER]: Becoming Leader. State: Replica: 7bb005ba381d44348c9493ecd49f37a7, State: Running, Role: LEADER
I20260620 22:07:42.354230 21729 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:42.354275 21738 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb005ba381d44348c9493ecd49f37a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38907 } }
I20260620 22:07:42.354547 21738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bb005ba381d44348c9493ecd49f37a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb005ba381d44348c9493ecd49f37a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38907 } } }
I20260620 22:07:42.354669 21738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:42.354882 21738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bb005ba381d44348c9493ecd49f37a7. Latest consensus state: current_term: 1 leader_uuid: "7bb005ba381d44348c9493ecd49f37a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bb005ba381d44348c9493ecd49f37a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38907 } } }
I20260620 22:07:42.354995 21738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:42.355082 21733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:42.354051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38847 (local address 127.0.0.1:38907)
0620 22:07:42.354091 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:42.354093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:42.354171 (+ 78us) server_negotiation.cc:407] Connection header received
0620 22:07:42.354242 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:42.354243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:42.354247 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:42.354302 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:42.354848 (+ 546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:42.354849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:42.354849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:42.354853 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:42.354866 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:42.354870 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:42.354901 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:42.355014 (+ 113us) server_negotiation.cc:299] Negotiation successful
0620 22:07:42.355027 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:07:42.355297 21748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:42.355818 21748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:42.357378 21748 catalog_manager.cc:1347] Generated new cluster ID: 4d5d2afb04b04f15b6537323baf4c859
I20260620 22:07:42.357426 21748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:42.368073 21748 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:42.368225 21748 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:42.371611 21748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bb005ba381d44348c9493ecd49f37a7: Generated new TSK 0
I20260620 22:07:42.371769 21748 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:42.377900 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 21661
2026-06-20T22:07:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1261 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:42 dist-test-slave-xw35 krb5kdc[21760](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:42 dist-test-slave-xw35 krb5kdc[21760](info): set up 2 sockets
Jun 20 22:07:42 dist-test-slave-xw35 krb5kdc[21760](info): commencing operation
krb5kdc: starting...
W20260620 22:07:43.373294 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.978s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:43 dist-test-slave-xw35 krb5kdc[21760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:43.480268 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32961
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:43.557068 21773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:43.557250 21773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:43.557273 21773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:43.558406 21773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:43.558445 21773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:43.558459 21773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:43.558501 21773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:43.558526 21773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:43.559887 21773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:43.560130 21773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:43.560364 21773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:43.564883 21781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:43.564911 21779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:43.565002 21778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:43.565071 21773 server_base.cc:1034] running on GCE node
I20260620 22:07:43.565428 21773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:43.565742 21773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:43.566972 21773 hybrid_clock.cc:648] HybridClock initialized: now 1781993263566960 us; error 26 us; skew 500 ppm
Jun 20 22:07:43 dist-test-slave-xw35 krb5kdc[21760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993263, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:43.569604 21773 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:43.570118 21773 webserver.cc:460] Webserver started at http://127.0.0.1:43841/ using document root <none> and password file <none>
I20260620 22:07:43.570402 21773 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:43.570463 21773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:43.570582 21773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:43.571923 21773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "4c966ad0537a499a9f5202cad08da41d"
format_stamp: "Formatted at 2026-06-20 22:07:43 on dist-test-slave-xw35"
server_key: "acd2c95b07599c71bdfccb1b2e99912f"
server_key_iv: "642f7a381aaf41942c3fb45ccffdc8bf"
server_key_version: "encryptionkey@0"
I20260620 22:07:43.572391 21773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "4c966ad0537a499a9f5202cad08da41d"
format_stamp: "Formatted at 2026-06-20 22:07:43 on dist-test-slave-xw35"
server_key: "acd2c95b07599c71bdfccb1b2e99912f"
server_key_iv: "642f7a381aaf41942c3fb45ccffdc8bf"
server_key_version: "encryptionkey@0"
I20260620 22:07:43.574252 21773 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260620 22:07:43.575193 21788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:43.575394 21773 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:43.575479 21773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "4c966ad0537a499a9f5202cad08da41d"
format_stamp: "Formatted at 2026-06-20 22:07:43 on dist-test-slave-xw35"
server_key: "acd2c95b07599c71bdfccb1b2e99912f"
server_key_iv: "642f7a381aaf41942c3fb45ccffdc8bf"
server_key_version: "encryptionkey@0"
I20260620 22:07:43.575541 21773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:43.591879 21773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:43.594528 21773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:43.594671 21773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:43.599013 21773 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32961
I20260620 22:07:43.599045 21840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32961 every 8 connection(s)
I20260620 22:07:43.599368 21773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:43.600311 21841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:43.602604 21841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d: Bootstrap starting.
I20260620 22:07:43.603157 21841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:43.603431 21841 log.cc:824] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:43.604045 21841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d: No bootstrap required, opened a new log
I20260620 22:07:43.604450 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 21773
I20260620 22:07:43.604559 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:43.604717 1247 external_mini_cluster.cc:1428] Setting key 86f8e3712d73b65b97d6e13104b3bb05
I20260620 22:07:43.606065 21841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c966ad0537a499a9f5202cad08da41d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } }
I20260620 22:07:43.606273 21841 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:43.606333 21841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c966ad0537a499a9f5202cad08da41d, State: Initialized, Role: FOLLOWER
I20260620 22:07:43.606457 21841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c966ad0537a499a9f5202cad08da41d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } }
I20260620 22:07:43.606552 21841 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:43.606585 21841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:43.606640 21841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:43.607577 21841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c966ad0537a499a9f5202cad08da41d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } }
I20260620 22:07:43.607702 21841 leader_election.cc:302] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c966ad0537a499a9f5202cad08da41d; no voters:
I20260620 22:07:43.607903 21841 leader_election.cc:288] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:43.607928 21846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:43.608088 21846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [term 1 LEADER]: Becoming Leader. State: Replica: 4c966ad0537a499a9f5202cad08da41d, State: Running, Role: LEADER
I20260620 22:07:43.608196 21841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:43.608212 21846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c966ad0537a499a9f5202cad08da41d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } }
I20260620 22:07:43.609740 21847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c966ad0537a499a9f5202cad08da41d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c966ad0537a499a9f5202cad08da41d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } } }
I20260620 22:07:43.609848 21847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:43.610042 21848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c966ad0537a499a9f5202cad08da41d. Latest consensus state: current_term: 1 leader_uuid: "4c966ad0537a499a9f5202cad08da41d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c966ad0537a499a9f5202cad08da41d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32961 } } }
I20260620 22:07:43.610157 21848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d [sys.catalog]: This master's current role is: LEADER
W20260620 22:07:43.610316 21861 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:07:43.610416 21861 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:07:43.610493 21862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:43.610661 21862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Jun 20 22:07:43 dist-test-slave-xw35 krb5kdc[21760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260620 22:07:43.612705 21862 catalog_manager.cc:1347] Generated new cluster ID: 2c9fda3e9f244662aa33d633400a55e0
I20260620 22:07:43.612789 21862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:43.616321 21845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:43.605174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43675 (local address 127.0.0.1:32961)
0620 22:07:43.605345 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:43.605352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:43.605683 (+ 331us) server_negotiation.cc:407] Connection header received
0620 22:07:43.606042 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:43.606048 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:43.606089 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:43.606194 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:43.607019 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:43.608052 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:43.608950 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:43.609442 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:43.609590 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:43.612620 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:43.612623 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:43.612624 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:43.612632 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:43.614866 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:43.615263 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:43.615266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:43.615266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:43.615371 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:43.615579 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:43.615580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:43.615581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:43.615799 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:43.615975 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:43.616037 (+ 62us) server_negotiation.cc:299] Negotiation successful
0620 22:07:43.616169 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
I20260620 22:07:43.617161 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:43.618170 21862 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:43.618810 21862 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:43.625748 21862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c966ad0537a499a9f5202cad08da41d: Generated new TSK 0
I20260620 22:07:43.625896 21862 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:43.627797 21845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:43.621730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32867 (local address 127.0.0.1:32961)
0620 22:07:43.621762 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:43.621764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:43.621962 (+ 198us) server_negotiation.cc:407] Connection header received
0620 22:07:43.622028 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:43.622029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:43.622039 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:43.622130 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:43.622596 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:43.623023 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:43.623725 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:43.623954 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:43.624059 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:43.625190 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:43.625192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:43.625192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:43.625200 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:43.626652 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:43.627035 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:43.627036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:43.627036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:43.627087 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:43.627304 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:43.627304 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:43.627305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:43.627410 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:43.627502 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:43.627616 (+ 114us) server_negotiation.cc:299] Negotiation successful
0620 22:07:43.627687 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:07:43.629750 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 21773
2026-06-20T22:07:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1251 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:43 dist-test-slave-xw35 krb5kdc[21872](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:43 dist-test-slave-xw35 krb5kdc[21872](info): set up 2 sockets
Jun 20 22:07:43 dist-test-slave-xw35 krb5kdc[21872](info): commencing operation
krb5kdc: starting...
W20260620 22:07:44.637332 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.990s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:44 dist-test-slave-xw35 krb5kdc[21872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993264, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:44.742542 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38005
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:44.818351 21885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:44.818518 21885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:44.818538 21885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:44.819478 21885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:44.819509 21885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:44.819522 21885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:44.819552 21885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:44.819563 21885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:44.820801 21885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:44.820983 21885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:44.821138 21885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:44.825459 21893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:44.825466 21890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:44.825661 21885 server_base.cc:1034] running on GCE node
W20260620 22:07:44.825536 21891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:44.825980 21885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:44.826246 21885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:44.827383 21885 hybrid_clock.cc:648] HybridClock initialized: now 1781993264827367 us; error 33 us; skew 500 ppm
Jun 20 22:07:44 dist-test-slave-xw35 krb5kdc[21872](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993264, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:44.829723 21885 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:44.830106 21885 webserver.cc:460] Webserver started at http://127.0.0.1:45263/ using document root <none> and password file <none>
I20260620 22:07:44.830322 21885 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:44.830371 21885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:44.830528 21885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:44.831496 21885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "939e956e62b84c2bb7a166a1bb70714e"
format_stamp: "Formatted at 2026-06-20 22:07:44 on dist-test-slave-xw35"
server_key: "6a77cc595e2dd7fd4bd85a58fbd93135"
server_key_iv: "2e502b2f25981a57b5b8dd159d856584"
server_key_version: "encryptionkey@0"
I20260620 22:07:44.831841 21885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "939e956e62b84c2bb7a166a1bb70714e"
format_stamp: "Formatted at 2026-06-20 22:07:44 on dist-test-slave-xw35"
server_key: "6a77cc595e2dd7fd4bd85a58fbd93135"
server_key_iv: "2e502b2f25981a57b5b8dd159d856584"
server_key_version: "encryptionkey@0"
I20260620 22:07:44.833015 21885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:44.833789 21900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:44.833978 21885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:44.834060 21885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "939e956e62b84c2bb7a166a1bb70714e"
format_stamp: "Formatted at 2026-06-20 22:07:44 on dist-test-slave-xw35"
server_key: "6a77cc595e2dd7fd4bd85a58fbd93135"
server_key_iv: "2e502b2f25981a57b5b8dd159d856584"
server_key_version: "encryptionkey@0"
I20260620 22:07:44.834111 21885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:44.850778 21885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:44.852981 21885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:44.853084 21885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:44.856642 21885 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38005
I20260620 22:07:44.856714 21952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38005 every 8 connection(s)
I20260620 22:07:44.857055 21885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:44.858042 21953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:44.859972 21953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e: Bootstrap starting.
I20260620 22:07:44.860442 21953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:44.860658 21953 log.cc:824] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:44.861261 21953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e: No bootstrap required, opened a new log
I20260620 22:07:44.862772 21953 raft_consensus.cc:348] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939e956e62b84c2bb7a166a1bb70714e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } }
I20260620 22:07:44.862938 21953 raft_consensus.cc:374] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:44.862960 21953 raft_consensus.cc:729] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 939e956e62b84c2bb7a166a1bb70714e, State: Initialized, Role: FOLLOWER
I20260620 22:07:44.863086 21953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939e956e62b84c2bb7a166a1bb70714e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } }
I20260620 22:07:44.863163 21953 raft_consensus.cc:388] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:44.863185 21953 raft_consensus.cc:482] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:44.863212 21953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:44.863667 21953 raft_consensus.cc:504] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939e956e62b84c2bb7a166a1bb70714e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } }
I20260620 22:07:44.863747 21953 leader_election.cc:302] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 939e956e62b84c2bb7a166a1bb70714e; no voters:
I20260620 22:07:44.863889 21953 leader_election.cc:288] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:44.863925 21956 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:44.864045 21956 raft_consensus.cc:686] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [term 1 LEADER]: Becoming Leader. State: Replica: 939e956e62b84c2bb7a166a1bb70714e, State: Running, Role: LEADER
I20260620 22:07:44.864153 21953 sys_catalog.cc:564] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:44.864189 21956 consensus_queue.cc:237] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939e956e62b84c2bb7a166a1bb70714e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } }
I20260620 22:07:44.864609 21958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 939e956e62b84c2bb7a166a1bb70714e. Latest consensus state: current_term: 1 leader_uuid: "939e956e62b84c2bb7a166a1bb70714e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939e956e62b84c2bb7a166a1bb70714e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } } }
I20260620 22:07:44.864701 21957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "939e956e62b84c2bb7a166a1bb70714e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "939e956e62b84c2bb7a166a1bb70714e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38005 } } }
I20260620 22:07:44.864759 21958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:44.864836 21957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:44.865172 21965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:44.865667 21965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:44.866967 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 21885
I20260620 22:07:44.867092 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:44.867195 21965 catalog_manager.cc:1347] Generated new cluster ID: cd14ef6865ef4668922b12f738c77153
I20260620 22:07:44.867264 21965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:44.867274 1247 external_mini_cluster.cc:1428] Setting key 405de6737407fdd761f27072d1f31b1f
I20260620 22:07:44.873274 21976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:44.867845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39509 (local address 127.0.0.1:38005)
0620 22:07:44.867994 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:44.868003 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:44.868030 (+ 27us) server_negotiation.cc:407] Connection header received
0620 22:07:44.868132 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:44.868139 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:44.868187 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:44.868306 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:44.868598 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:44.870023 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:44.871088 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:44.871687 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:44.871767 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:44.872493 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:44.872497 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:44.872497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:44.872707 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:44.872739 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:44.872751 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:44.872799 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:44.873027 (+ 228us) server_negotiation.cc:299] Negotiation successful
0620 22:07:44.873084 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
I20260620 22:07:44.874496 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:44.878499 21965 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:44.879180 21965 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:44.879339 21976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:44.875977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58775 (local address 127.0.0.1:38005)
0620 22:07:44.876006 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:44.876008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:44.876032 (+ 24us) server_negotiation.cc:407] Connection header received
0620 22:07:44.876103 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:44.876104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:44.876112 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:44.876155 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:44.876279 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:44.876982 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:44.878035 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:44.878290 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:44.878365 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:44.879072 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:44.879073 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:44.879074 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:44.879078 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:44.879091 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:44.879094 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:44.879149 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:44.879205 (+ 56us) server_negotiation.cc:299] Negotiation successful
0620 22:07:44.879260 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:07:44.894279 21965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 939e956e62b84c2bb7a166a1bb70714e: Generated new TSK 0
I20260620 22:07:44.894467 21965 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:44.899471 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 21885
2026-06-20T22:07:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1270 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:44 dist-test-slave-xw35 krb5kdc[21984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:44 dist-test-slave-xw35 krb5kdc[21984](info): set up 2 sockets
Jun 20 22:07:44 dist-test-slave-xw35 krb5kdc[21984](info): commencing operation
krb5kdc: starting...
W20260620 22:07:45.905154 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.988s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:45 dist-test-slave-xw35 krb5kdc[21984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:46.015724 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40497
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:46.092334 21997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:46.092509 21997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:46.092531 21997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:46.093644 21997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:46.093684 21997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:46.093698 21997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:46.093710 21997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:46.093722 21997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:46.095118 21997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:46.095350 21997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:46.095558 21997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:46.100063 22002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:46.100107 22003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:46.100291 21997 server_base.cc:1034] running on GCE node
W20260620 22:07:46.100068 22005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:46.100560 21997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:46.100817 21997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:46.101977 21997 hybrid_clock.cc:648] HybridClock initialized: now 1781993266101966 us; error 28 us; skew 500 ppm
Jun 20 22:07:46 dist-test-slave-xw35 krb5kdc[21984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993266, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:46.104199 21997 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:46.104547 21997 webserver.cc:460] Webserver started at http://127.0.0.1:44959/ using document root <none> and password file <none>
I20260620 22:07:46.104725 21997 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:46.104763 21997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:46.104848 21997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:46.105886 21997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "f983ad05de6b4427a312e1d69148b098"
format_stamp: "Formatted at 2026-06-20 22:07:46 on dist-test-slave-xw35"
server_key: "e43ab1031ecaa81c9f7eda39c89627f2"
server_key_iv: "68f95a207397298dcb6f10725bf6380a"
server_key_version: "encryptionkey@0"
I20260620 22:07:46.106160 21997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "f983ad05de6b4427a312e1d69148b098"
format_stamp: "Formatted at 2026-06-20 22:07:46 on dist-test-slave-xw35"
server_key: "e43ab1031ecaa81c9f7eda39c89627f2"
server_key_iv: "68f95a207397298dcb6f10725bf6380a"
server_key_version: "encryptionkey@0"
I20260620 22:07:46.107328 21997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:46.108011 22012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:46.108196 21997 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:07:46.108264 21997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "f983ad05de6b4427a312e1d69148b098"
format_stamp: "Formatted at 2026-06-20 22:07:46 on dist-test-slave-xw35"
server_key: "e43ab1031ecaa81c9f7eda39c89627f2"
server_key_iv: "68f95a207397298dcb6f10725bf6380a"
server_key_version: "encryptionkey@0"
I20260620 22:07:46.108352 21997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:46.111464 21997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:46.113227 21997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:46.113365 21997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:46.117113 21997 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40497
I20260620 22:07:46.117161 22064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40497 every 8 connection(s)
I20260620 22:07:46.117439 21997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:46.118325 22065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:46.119635 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 21997
I20260620 22:07:46.119750 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:46.119948 1247 external_mini_cluster.cc:1428] Setting key ce109b2934e08236b554f013e2bc0dd8
I20260620 22:07:46.120841 22065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098: Bootstrap starting.
I20260620 22:07:46.121572 22065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:46.121866 22065 log.cc:824] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:46.122504 22065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098: No bootstrap required, opened a new log
I20260620 22:07:46.124065 22065 raft_consensus.cc:348] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f983ad05de6b4427a312e1d69148b098" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40497 } }
I20260620 22:07:46.124181 22065 raft_consensus.cc:374] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:46.124202 22065 raft_consensus.cc:729] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f983ad05de6b4427a312e1d69148b098, State: Initialized, Role: FOLLOWER
I20260620 22:07:46.124359 22065 consensus_queue.cc:260] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f983ad05de6b4427a312e1d69148b098" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40497 } }
I20260620 22:07:46.124425 22065 raft_consensus.cc:388] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:46.124464 22065 raft_consensus.cc:482] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:46.124507 22065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:46.124955 22065 raft_consensus.cc:504] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f983ad05de6b4427a312e1d69148b098" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40497 } }
I20260620 22:07:46.125056 22065 leader_election.cc:302] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f983ad05de6b4427a312e1d69148b098; no voters:
I20260620 22:07:46.125221 22065 leader_election.cc:288] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:46.125277 22070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:46.125413 22070 raft_consensus.cc:686] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [term 1 LEADER]: Becoming Leader. State: Replica: f983ad05de6b4427a312e1d69148b098, State: Running, Role: LEADER
I20260620 22:07:46.125450 22065 sys_catalog.cc:564] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:46.125531 22070 consensus_queue.cc:237] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f983ad05de6b4427a312e1d69148b098" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40497 } }
I20260620 22:07:46.125871 22071 sys_catalog.cc:455] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f983ad05de6b4427a312e1d69148b098" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f983ad05de6b4427a312e1d69148b098" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40497 } } }
I20260620 22:07:46.126024 22071 sys_catalog.cc:458] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:46.125871 22072 sys_catalog.cc:455] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f983ad05de6b4427a312e1d69148b098. Latest consensus state: current_term: 1 leader_uuid: "f983ad05de6b4427a312e1d69148b098" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f983ad05de6b4427a312e1d69148b098" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40497 } } }
I20260620 22:07:46.126174 22072 sys_catalog.cc:458] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:46.126355 22079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:46.126816 22079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:46.126951 22068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:46.120410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54897 (local address 127.0.0.1:40497)
0620 22:07:46.120576 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:46.120583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:46.120604 (+ 21us) server_negotiation.cc:407] Connection header received
0620 22:07:46.121039 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:46.121045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:46.121070 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:46.121178 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:46.126327 (+ 5149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:46.126330 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:46.126331 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:46.126335 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:46.126375 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:46.126390 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:46.126456 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:46.126676 (+ 220us) server_negotiation.cc:299] Negotiation successful
0620 22:07:46.126713 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":80,"threads_started":1}
I20260620 22:07:46.128000 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:46.128270 22079 catalog_manager.cc:1347] Generated new cluster ID: 288de44b2e9648da9674a5c78dc523e9
I20260620 22:07:46.128319 22079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:46.130203 22068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:46.129395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33589 (local address 127.0.0.1:40497)
0620 22:07:46.129424 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:46.129426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:46.129497 (+ 71us) server_negotiation.cc:407] Connection header received
0620 22:07:46.129619 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:46.129619 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:46.129623 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:46.129667 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:46.130060 (+ 393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:46.130061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:46.130061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:46.130064 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:46.130073 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:46.130077 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:46.130115 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:46.130159 (+ 44us) server_negotiation.cc:299] Negotiation successful
0620 22:07:46.130168 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:07:46.141959 22079 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:46.142120 22079 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:46.147017 22079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f983ad05de6b4427a312e1d69148b098: Generated new TSK 0
I20260620 22:07:46.147169 22079 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:46.152069 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 21997
2026-06-20T22:07:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1252 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:46 dist-test-slave-xw35 krb5kdc[22096](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:46 dist-test-slave-xw35 krb5kdc[22096](info): set up 2 sockets
Jun 20 22:07:46 dist-test-slave-xw35 krb5kdc[22096](info): commencing operation
krb5kdc: starting...
W20260620 22:07:47.141292 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.972s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:47 dist-test-slave-xw35 krb5kdc[22096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:47.249851 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43033
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43033
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:47.326566 22109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:47.326748 22109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:47.326771 22109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:47.327879 22109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:47.327917 22109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:47.327931 22109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:47.327944 22109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:47.327956 22109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:47.329321 22109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:47.329574 22109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:47.329746 22109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:47.334221 22114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:47.334286 22109 server_base.cc:1034] running on GCE node
W20260620 22:07:47.334228 22115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:47.334234 22117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:47.334645 22109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:47.334936 22109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:47.336097 22109 hybrid_clock.cc:648] HybridClock initialized: now 1781993267336084 us; error 29 us; skew 500 ppm
Jun 20 22:07:47 dist-test-slave-xw35 krb5kdc[22096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:47.338445 22109 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:47.338884 22109 webserver.cc:460] Webserver started at http://127.0.0.1:44075/ using document root <none> and password file <none>
I20260620 22:07:47.339108 22109 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:47.339172 22109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:47.339319 22109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:47.340476 22109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "4ee938e9197e44e6973711cd9f97e08d"
format_stamp: "Formatted at 2026-06-20 22:07:47 on dist-test-slave-xw35"
server_key: "09760ed7890b6bd2c1a0fc6f95c87c26"
server_key_iv: "1aa0a961d600b450f9107f06db65aced"
server_key_version: "encryptionkey@0"
I20260620 22:07:47.340831 22109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "4ee938e9197e44e6973711cd9f97e08d"
format_stamp: "Formatted at 2026-06-20 22:07:47 on dist-test-slave-xw35"
server_key: "09760ed7890b6bd2c1a0fc6f95c87c26"
server_key_iv: "1aa0a961d600b450f9107f06db65aced"
server_key_version: "encryptionkey@0"
I20260620 22:07:47.342202 22109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:07:47.342890 22124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:47.343060 22109 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:47.343155 22109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "4ee938e9197e44e6973711cd9f97e08d"
format_stamp: "Formatted at 2026-06-20 22:07:47 on dist-test-slave-xw35"
server_key: "09760ed7890b6bd2c1a0fc6f95c87c26"
server_key_iv: "1aa0a961d600b450f9107f06db65aced"
server_key_version: "encryptionkey@0"
I20260620 22:07:47.343228 22109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:47.361445 22109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:47.363304 22109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:47.363469 22109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:47.367349 22109 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43033
I20260620 22:07:47.367388 22176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43033 every 8 connection(s)
I20260620 22:07:47.367700 22109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:47.368667 22177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:47.370718 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d: Bootstrap starting.
I20260620 22:07:47.371243 22177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:47.371479 22177 log.cc:824] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:47.372128 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d: No bootstrap required, opened a new log
I20260620 22:07:47.373809 22177 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee938e9197e44e6973711cd9f97e08d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43033 } }
I20260620 22:07:47.373965 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 22109
I20260620 22:07:47.373989 22177 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:47.374027 22177 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ee938e9197e44e6973711cd9f97e08d, State: Initialized, Role: FOLLOWER
I20260620 22:07:47.374081 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:47.374176 22177 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee938e9197e44e6973711cd9f97e08d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43033 } }
I20260620 22:07:47.374254 22177 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:47.374248 1247 external_mini_cluster.cc:1428] Setting key 235c24fda32141f8eb8ad645bfe2560c
I20260620 22:07:47.374289 22177 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:47.374338 22177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:47.375327 22177 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee938e9197e44e6973711cd9f97e08d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43033 } }
I20260620 22:07:47.375456 22177 leader_election.cc:302] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ee938e9197e44e6973711cd9f97e08d; no voters:
I20260620 22:07:47.375607 22177 leader_election.cc:288] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:47.375663 22182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:47.375833 22182 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [term 1 LEADER]: Becoming Leader. State: Replica: 4ee938e9197e44e6973711cd9f97e08d, State: Running, Role: LEADER
I20260620 22:07:47.375849 22177 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:47.375916 22182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee938e9197e44e6973711cd9f97e08d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43033 } }
I20260620 22:07:47.376221 22182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ee938e9197e44e6973711cd9f97e08d. Latest consensus state: current_term: 1 leader_uuid: "4ee938e9197e44e6973711cd9f97e08d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee938e9197e44e6973711cd9f97e08d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43033 } } }
I20260620 22:07:47.376230 22183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ee938e9197e44e6973711cd9f97e08d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee938e9197e44e6973711cd9f97e08d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43033 } } }
I20260620 22:07:47.376417 22183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:47.376577 22182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:47.376928 22191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:47.377415 22191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:47.378897 22191 catalog_manager.cc:1347] Generated new cluster ID: 7c5b55d6a18642c29679b79d8ffe0a7b
I20260620 22:07:47.378952 22191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:07:47 dist-test-slave-xw35 krb5kdc[22096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993267, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260620 22:07:47.384994 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:47.374739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:46107 (local address 127.0.0.1:43033)
0620 22:07:47.374914 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:47.374922 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:47.374950 (+ 28us) server_negotiation.cc:407] Connection header received
0620 22:07:47.375036 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:47.375041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:47.375079 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:47.375187 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:47.375953 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:47.377646 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:47.378715 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:47.379228 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:47.379368 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:47.381739 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:47.381743 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:47.381743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:47.381754 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:47.383470 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:47.383879 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:47.383882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:47.383882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:47.383983 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:47.384212 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:47.384214 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:47.384214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:47.384435 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:47.384633 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:47.384716 (+ 83us) server_negotiation.cc:299] Negotiation successful
0620 22:07:47.384812 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":104,"threads_started":1}
I20260620 22:07:47.385843 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:47.390924 22191 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:47.391788 22191 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:47.392915 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:47.387140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:41423 (local address 127.0.0.1:43033)
0620 22:07:47.387176 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:47.387179 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:47.387298 (+ 119us) server_negotiation.cc:407] Connection header received
0620 22:07:47.387370 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:47.387371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:47.387380 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:47.387434 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:47.387933 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:47.388408 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:47.389106 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:47.389319 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:47.389398 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:47.390450 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:47.390451 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:47.390452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:47.390458 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:47.391765 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:47.392137 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:47.392138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:47.392138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:47.392187 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:47.392426 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:47.392427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:47.392427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:47.392545 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:47.392647 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:47.392764 (+ 117us) server_negotiation.cc:299] Negotiation successful
0620 22:07:47.392821 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:07:47.399406 22191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ee938e9197e44e6973711cd9f97e08d: Generated new TSK 0
I20260620 22:07:47.399552 22191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:47.401628 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 22109
W20260620 22:07:47.405669 22094 connection.cc:535] client connection to 127.0.0.1:43033 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43033): Connection reset by peer (error 104)
2026-06-20T22:07:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1249 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:47 dist-test-slave-xw35 krb5kdc[22208](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:47 dist-test-slave-xw35 krb5kdc[22208](info): set up 2 sockets
Jun 20 22:07:47 dist-test-slave-xw35 krb5kdc[22208](info): commencing operation
krb5kdc: starting...
W20260620 22:07:48.409440 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.990s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:48 dist-test-slave-xw35 krb5kdc[22208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:48.518270 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43683
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43683
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:48.593359 22221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:48.593554 22221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:48.593575 22221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:48.594575 22221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:48.594606 22221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:48.594630 22221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:48.594642 22221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:48.594652 22221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:48.595852 22221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43683
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:48.595999 22221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:48.596140 22221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:48.600481 22229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:48.600512 22227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:48.600715 22226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:48.600862 22221 server_base.cc:1034] running on GCE node
I20260620 22:07:48.601116 22221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:48.601395 22221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:48.602545 22221 hybrid_clock.cc:648] HybridClock initialized: now 1781993268602545 us; error 51 us; skew 500 ppm
Jun 20 22:07:48 dist-test-slave-xw35 krb5kdc[22208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993268, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:48.604867 22221 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:48.605307 22221 webserver.cc:460] Webserver started at http://127.0.0.1:38925/ using document root <none> and password file <none>
I20260620 22:07:48.605593 22221 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:48.605674 22221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:48.605799 22221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:48.606765 22221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "9147304468a8491b8b8a7a1d6fa2aacf"
format_stamp: "Formatted at 2026-06-20 22:07:48 on dist-test-slave-xw35"
server_key: "73f0d32630bc18fdf2c5bf61ab8b8621"
server_key_iv: "b54ff8b663abec2f0afad0e36ac08fea"
server_key_version: "encryptionkey@0"
I20260620 22:07:48.607103 22221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "9147304468a8491b8b8a7a1d6fa2aacf"
format_stamp: "Formatted at 2026-06-20 22:07:48 on dist-test-slave-xw35"
server_key: "73f0d32630bc18fdf2c5bf61ab8b8621"
server_key_iv: "b54ff8b663abec2f0afad0e36ac08fea"
server_key_version: "encryptionkey@0"
I20260620 22:07:48.608355 22221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:07:48.609071 22236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:48.609242 22221 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:48.609349 22221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "9147304468a8491b8b8a7a1d6fa2aacf"
format_stamp: "Formatted at 2026-06-20 22:07:48 on dist-test-slave-xw35"
server_key: "73f0d32630bc18fdf2c5bf61ab8b8621"
server_key_iv: "b54ff8b663abec2f0afad0e36ac08fea"
server_key_version: "encryptionkey@0"
I20260620 22:07:48.609431 22221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:48.625913 22221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:48.628091 22221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:48.628247 22221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:48.632054 22221 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43683
I20260620 22:07:48.632086 22288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43683 every 8 connection(s)
I20260620 22:07:48.632455 22221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:48.633366 22289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:48.635996 22289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf: Bootstrap starting.
I20260620 22:07:48.636549 22289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:48.636845 22289 log.cc:824] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:48.637590 22289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf: No bootstrap required, opened a new log
I20260620 22:07:48.639127 22289 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9147304468a8491b8b8a7a1d6fa2aacf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43683 } }
I20260620 22:07:48.639273 22289 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:48.639310 22289 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9147304468a8491b8b8a7a1d6fa2aacf, State: Initialized, Role: FOLLOWER
I20260620 22:07:48.639492 22289 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9147304468a8491b8b8a7a1d6fa2aacf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43683 } }
I20260620 22:07:48.639572 22289 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:48.639621 22289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:48.639668 22289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:48.640254 22289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9147304468a8491b8b8a7a1d6fa2aacf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43683 } }
I20260620 22:07:48.640372 22289 leader_election.cc:302] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9147304468a8491b8b8a7a1d6fa2aacf; no voters:
I20260620 22:07:48.640560 22289 leader_election.cc:288] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:48.640589 22292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:48.640753 22292 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [term 1 LEADER]: Becoming Leader. State: Replica: 9147304468a8491b8b8a7a1d6fa2aacf, State: Running, Role: LEADER
I20260620 22:07:48.640815 22289 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:48.640894 22292 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9147304468a8491b8b8a7a1d6fa2aacf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43683 } }
I20260620 22:07:48.642032 22293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9147304468a8491b8b8a7a1d6fa2aacf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9147304468a8491b8b8a7a1d6fa2aacf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43683 } } }
I20260620 22:07:48.642118 22293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:48.642431 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 22221
I20260620 22:07:48.642268 22294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9147304468a8491b8b8a7a1d6fa2aacf. Latest consensus state: current_term: 1 leader_uuid: "9147304468a8491b8b8a7a1d6fa2aacf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9147304468a8491b8b8a7a1d6fa2aacf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43683 } } }
I20260620 22:07:48.642552 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:48.642555 22294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf [sys.catalog]: This master's current role is: LEADER
W20260620 22:07:48.642609 22307 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:07:48.642683 22307 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:07:48.642728 1247 external_mini_cluster.cc:1428] Setting key 59daf90c1a9632d7d8ef954b81a1ac0b
I20260620 22:07:48.644214 22308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:48.644474 22308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:48.648528 22308 catalog_manager.cc:1347] Generated new cluster ID: ee6ce3eefcc542fa894f13b01b2be6fa
I20260620 22:07:48.648581 22308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:48.650306 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:48.643171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:39641 (local address 127.0.0.1:43683)
0620 22:07:48.643338 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:48.643345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:48.645152 (+ 1807us) server_negotiation.cc:407] Connection header received
0620 22:07:48.645276 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:48.645283 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:48.645338 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:48.645496 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:48.645748 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:48.647162 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:48.648169 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:48.648860 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:48.648970 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:48.649680 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:48.649684 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:48.649684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:48.649880 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:48.649916 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:48.649930 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:48.650018 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:48.650094 (+ 76us) server_negotiation.cc:299] Negotiation successful
0620 22:07:48.650120 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260620 22:07:48.651153 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:48.653750 22308 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:48.654338 22308 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:48.655678 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:48.652677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:55131 (local address 127.0.0.1:43683)
0620 22:07:48.652735 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:48.652736 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:48.652743 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:07:48.652830 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:48.652831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:48.652840 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:48.652887 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:48.653007 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:48.653659 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:48.654546 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:48.654820 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:48.654850 (+ 30us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:48.655464 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:48.655465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:48.655465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:48.655468 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:48.655479 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:48.655482 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:48.655507 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:48.655610 (+ 103us) server_negotiation.cc:299] Negotiation successful
0620 22:07:48.655620 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260620 22:07:48.661244 22308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9147304468a8491b8b8a7a1d6fa2aacf: Generated new TSK 0
I20260620 22:07:48.661405 22308 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:48.668258 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 22221
W20260620 22:07:48.672557 22206 connection.cc:535] client connection to 127.0.0.1:43683 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43683): Connection reset by peer (error 104)
2026-06-20T22:07:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1267 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:48 dist-test-slave-xw35 krb5kdc[22320](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:48 dist-test-slave-xw35 krb5kdc[22320](info): set up 2 sockets
Jun 20 22:07:48 dist-test-slave-xw35 krb5kdc[22320](info): commencing operation
krb5kdc: starting...
W20260620 22:07:49.665396 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.979s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:49 dist-test-slave-xw35 krb5kdc[22320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993269, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:49.771373 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40419
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:49.848294 22333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:49.848513 22333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:49.848549 22333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:49.849735 22333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:49.849793 22333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:49.849817 22333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:49.849843 22333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:49.849869 22333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:49.851289 22333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:49.851612 22333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:49.851828 22333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:49.856572 22338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:49.856617 22341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:49.856750 22333 server_base.cc:1034] running on GCE node
W20260620 22:07:49.856628 22339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:49.857079 22333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:49.857331 22333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:49.858474 22333 hybrid_clock.cc:648] HybridClock initialized: now 1781993269858452 us; error 38 us; skew 500 ppm
Jun 20 22:07:49 dist-test-slave-xw35 krb5kdc[22320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993269, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:49.860731 22333 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:49.861162 22333 webserver.cc:460] Webserver started at http://127.0.0.1:45491/ using document root <none> and password file <none>
I20260620 22:07:49.861372 22333 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:49.861414 22333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:49.861588 22333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:49.862483 22333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "7e3e85e666bc473c9a052f31b9a84168"
format_stamp: "Formatted at 2026-06-20 22:07:49 on dist-test-slave-xw35"
server_key: "42f763dbda5ee36077dc9e3930771858"
server_key_iv: "cd7d8d348faa1825f9499767b71de447"
server_key_version: "encryptionkey@0"
I20260620 22:07:49.862756 22333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "7e3e85e666bc473c9a052f31b9a84168"
format_stamp: "Formatted at 2026-06-20 22:07:49 on dist-test-slave-xw35"
server_key: "42f763dbda5ee36077dc9e3930771858"
server_key_iv: "cd7d8d348faa1825f9499767b71de447"
server_key_version: "encryptionkey@0"
I20260620 22:07:49.863898 22333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:49.864581 22348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:49.864742 22333 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:49.864833 22333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "7e3e85e666bc473c9a052f31b9a84168"
format_stamp: "Formatted at 2026-06-20 22:07:49 on dist-test-slave-xw35"
server_key: "42f763dbda5ee36077dc9e3930771858"
server_key_iv: "cd7d8d348faa1825f9499767b71de447"
server_key_version: "encryptionkey@0"
I20260620 22:07:49.864910 22333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:49.868091 22333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:49.869983 22333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:49.870141 22333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:49.873852 22333 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40419
I20260620 22:07:49.873883 22400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40419 every 8 connection(s)
I20260620 22:07:49.874193 22333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:49.875108 22401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:49.875340 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 22333
I20260620 22:07:49.875475 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:49.875643 1247 external_mini_cluster.cc:1428] Setting key 68dd49f1f074c94a5df6b4131a5d3272
I20260620 22:07:49.878257 22401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168: Bootstrap starting.
I20260620 22:07:49.878400 22404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:49.876157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:33293 (local address 127.0.0.1:40419)
0620 22:07:49.876378 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:49.876387 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:49.876418 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:07:49.876967 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:49.876976 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:49.877006 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:49.877155 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:49.877806 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:49.877809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:49.877810 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:49.877814 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:49.877855 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:49.877869 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:49.877946 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:49.878052 (+ 106us) server_negotiation.cc:299] Negotiation successful
0620 22:07:49.878188 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":103,"threads_started":1}
I20260620 22:07:49.878880 22401 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:49.879210 22401 log.cc:824] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:49.879347 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:49.879900 22401 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168: No bootstrap required, opened a new log
I20260620 22:07:49.881708 22404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:49.880683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:47057 (local address 127.0.0.1:40419)
0620 22:07:49.880722 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:49.880724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:49.880790 (+ 66us) server_negotiation.cc:407] Connection header received
0620 22:07:49.880877 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:49.880878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:49.880882 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:49.880936 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:49.881516 (+ 580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:49.881517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:49.881517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:49.881521 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:49.881532 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:49.881536 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:49.881589 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:49.881638 (+ 49us) server_negotiation.cc:299] Negotiation successful
0620 22:07:49.881650 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:07:49.882032 22401 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3e85e666bc473c9a052f31b9a84168" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40419 } }
I20260620 22:07:49.882205 22401 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:49.882277 22401 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e3e85e666bc473c9a052f31b9a84168, State: Initialized, Role: FOLLOWER
I20260620 22:07:49.882393 22401 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3e85e666bc473c9a052f31b9a84168" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40419 } }
I20260620 22:07:49.882498 22401 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:49.882539 22401 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:49.882587 22401 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:49.883066 22401 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3e85e666bc473c9a052f31b9a84168" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40419 } }
I20260620 22:07:49.883169 22401 leader_election.cc:302] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e3e85e666bc473c9a052f31b9a84168; no voters:
I20260620 22:07:49.883363 22401 leader_election.cc:288] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:49.883423 22411 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:49.883565 22411 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [term 1 LEADER]: Becoming Leader. State: Replica: 7e3e85e666bc473c9a052f31b9a84168, State: Running, Role: LEADER
I20260620 22:07:49.883574 22401 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:49.883682 22411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3e85e666bc473c9a052f31b9a84168" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40419 } }
I20260620 22:07:49.884019 22412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e3e85e666bc473c9a052f31b9a84168" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3e85e666bc473c9a052f31b9a84168" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40419 } } }
I20260620 22:07:49.884117 22412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:49.884028 22413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e3e85e666bc473c9a052f31b9a84168. Latest consensus state: current_term: 1 leader_uuid: "7e3e85e666bc473c9a052f31b9a84168" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e3e85e666bc473c9a052f31b9a84168" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40419 } } }
I20260620 22:07:49.884193 22413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:49.884904 22419 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:49.885442 22419 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:49.886914 22419 catalog_manager.cc:1347] Generated new cluster ID: 02eb001578c94e8688100050e0a951a4
I20260620 22:07:49.886962 22419 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:49.907436 22419 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:49.907594 22419 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:49.913187 22419 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e3e85e666bc473c9a052f31b9a84168: Generated new TSK 0
I20260620 22:07:49.913364 22419 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:49.918113 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 22333
2026-06-20T22:07:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1249 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:49 dist-test-slave-xw35 krb5kdc[22432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:49 dist-test-slave-xw35 krb5kdc[22432](info): set up 2 sockets
Jun 20 22:07:49 dist-test-slave-xw35 krb5kdc[22432](info): commencing operation
krb5kdc: starting...
W20260620 22:07:50.937635 1247 mini_kdc.cc:121] Time spent starting KDC: real 1.002s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:51 dist-test-slave-xw35 krb5kdc[22432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:51.045262 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36137
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:51.120946 22445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:51.121165 22445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:51.121202 22445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:51.122296 22445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:51.122365 22445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:51.122387 22445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:51.122416 22445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:51.122445 22445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:51.123868 22445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36137
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:51.124112 22445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:51.124322 22445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:07:51.128937 22445 server_base.cc:1034] running on GCE node
W20260620 22:07:51.128938 22451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:51.128873 22450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:51.128872 22453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:51.129254 22445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:51.129568 22445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:51.130746 22445 hybrid_clock.cc:648] HybridClock initialized: now 1781993271130733 us; error 25 us; skew 500 ppm
Jun 20 22:07:51 dist-test-slave-xw35 krb5kdc[22432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993271, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:51.136466 22445 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:51.136797 22445 webserver.cc:460] Webserver started at http://127.0.0.1:42633/ using document root <none> and password file <none>
I20260620 22:07:51.136976 22445 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:51.137013 22445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:51.137092 22445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:51.138074 22445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "92a1be323d8f499fa6642abae7c0fdf6"
format_stamp: "Formatted at 2026-06-20 22:07:51 on dist-test-slave-xw35"
server_key: "6c33c80b289562a82c5abdd0b2fcee94"
server_key_iv: "895f6a4615a9b0c0e42d8113b57234bf"
server_key_version: "encryptionkey@0"
I20260620 22:07:51.138352 22445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "92a1be323d8f499fa6642abae7c0fdf6"
format_stamp: "Formatted at 2026-06-20 22:07:51 on dist-test-slave-xw35"
server_key: "6c33c80b289562a82c5abdd0b2fcee94"
server_key_iv: "895f6a4615a9b0c0e42d8113b57234bf"
server_key_version: "encryptionkey@0"
I20260620 22:07:51.139596 22445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:51.140244 22460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:51.140434 22445 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:51.140504 22445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "92a1be323d8f499fa6642abae7c0fdf6"
format_stamp: "Formatted at 2026-06-20 22:07:51 on dist-test-slave-xw35"
server_key: "6c33c80b289562a82c5abdd0b2fcee94"
server_key_iv: "895f6a4615a9b0c0e42d8113b57234bf"
server_key_version: "encryptionkey@0"
I20260620 22:07:51.140554 22445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:51.156054 22445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:51.158170 22445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:51.158272 22445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:51.161725 22445 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36137
I20260620 22:07:51.161787 22512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36137 every 8 connection(s)
I20260620 22:07:51.162093 22445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:51.162952 22513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:51.164968 22513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6: Bootstrap starting.
I20260620 22:07:51.165535 22513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:51.165817 22513 log.cc:824] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:51.166508 22513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6: No bootstrap required, opened a new log
I20260620 22:07:51.168011 22513 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a1be323d8f499fa6642abae7c0fdf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } }
I20260620 22:07:51.168160 22513 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:51.168205 22513 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92a1be323d8f499fa6642abae7c0fdf6, State: Initialized, Role: FOLLOWER
I20260620 22:07:51.168370 22513 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a1be323d8f499fa6642abae7c0fdf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } }
I20260620 22:07:51.168449 22513 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:51.168488 22513 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:51.168537 22513 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:51.169051 22513 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a1be323d8f499fa6642abae7c0fdf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } }
I20260620 22:07:51.169097 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 22445
I20260620 22:07:51.169162 22513 leader_election.cc:302] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92a1be323d8f499fa6642abae7c0fdf6; no voters:
I20260620 22:07:51.169201 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:51.169343 22513 leader_election.cc:288] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:51.169378 22516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:51.169425 1247 external_mini_cluster.cc:1428] Setting key 4619e22102bf4882067097fa98d6c4be
I20260620 22:07:51.169515 22516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [term 1 LEADER]: Becoming Leader. State: Replica: 92a1be323d8f499fa6642abae7c0fdf6, State: Running, Role: LEADER
I20260620 22:07:51.169610 22513 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:51.169653 22516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a1be323d8f499fa6642abae7c0fdf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } }
I20260620 22:07:51.170375 22517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92a1be323d8f499fa6642abae7c0fdf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a1be323d8f499fa6642abae7c0fdf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } } }
I20260620 22:07:51.170396 22518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92a1be323d8f499fa6642abae7c0fdf6. Latest consensus state: current_term: 1 leader_uuid: "92a1be323d8f499fa6642abae7c0fdf6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92a1be323d8f499fa6642abae7c0fdf6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36137 } } }
I20260620 22:07:51.170457 22517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:51.170490 22518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:51.170679 22527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:51.171200 22527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:51.172895 22527 catalog_manager.cc:1347] Generated new cluster ID: 8dca2e9f7bc94674ab185ecec3b989c4
I20260620 22:07:51.172950 22527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:07:51 dist-test-slave-xw35 krb5kdc[22432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260620 22:07:51.180732 22520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:51.169964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:38775 (local address 127.0.0.1:36137)
0620 22:07:51.170146 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:51.170156 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:51.170188 (+ 32us) server_negotiation.cc:407] Connection header received
0620 22:07:51.170315 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:51.170321 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:51.170378 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:51.171277 (+ 899us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:51.171380 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:51.172640 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:51.173780 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:51.174394 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:51.174512 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:51.177165 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:51.177169 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:51.177169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:51.177179 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:51.179080 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:51.179528 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:51.179530 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:51.179531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:51.179636 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:51.179877 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:51.179877 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:51.179878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:51.180143 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:51.180280 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:51.180440 (+ 160us) server_negotiation.cc:299] Negotiation successful
0620 22:07:51.180534 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":89,"threads_started":1}
I20260620 22:07:51.181905 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:51.185835 22527 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:51.186255 22527 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:51.190907 22527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92a1be323d8f499fa6642abae7c0fdf6: Generated new TSK 0
I20260620 22:07:51.191087 22527 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:51.196031 22520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:51.183372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:53321 (local address 127.0.0.1:36137)
0620 22:07:51.183399 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:51.183401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:51.185583 (+ 2182us) server_negotiation.cc:407] Connection header received
0620 22:07:51.185658 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:51.185659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:51.185668 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:51.185739 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:51.191130 (+ 5391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:51.191583 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:51.192253 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:51.192466 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:51.192536 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:51.193641 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:51.193642 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:51.193643 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:51.193649 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:51.194905 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:51.195256 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:51.195257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:51.195257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:51.195311 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:51.195540 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:51.195541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:51.195541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:51.195674 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:51.195787 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:51.195891 (+ 104us) server_negotiation.cc:299] Negotiation successful
0620 22:07:51.195948 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:07:51.197708 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 22445
W20260620 22:07:51.201535 22430 connection.cc:535] client connection to 127.0.0.1:36137 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36137): Connection reset by peer (error 104)
2026-06-20T22:07:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1279 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:51 dist-test-slave-xw35 krb5kdc[22544](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:51 dist-test-slave-xw35 krb5kdc[22544](info): set up 2 sockets
Jun 20 22:07:51 dist-test-slave-xw35 krb5kdc[22544](info): commencing operation
krb5kdc: starting...
W20260620 22:07:52.213559 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.998s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:52 dist-test-slave-xw35 krb5kdc[22544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993272, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:52.318002 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44811
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:52.392925 22557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:52.393141 22557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:52.393194 22557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:52.394403 22557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:52.394445 22557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:52.394459 22557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:52.394495 22557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:52.394524 22557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:52.395859 22557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44811
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:52.396085 22557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:52.396275 22557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:52.400645 22562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:52.400741 22563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:52.400784 22557 server_base.cc:1034] running on GCE node
W20260620 22:07:52.400722 22565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:52.401185 22557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:52.401439 22557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:52.402616 22557 hybrid_clock.cc:648] HybridClock initialized: now 1781993272402600 us; error 33 us; skew 500 ppm
Jun 20 22:07:52 dist-test-slave-xw35 krb5kdc[22544](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993272, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:52.404824 22557 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:52.405166 22557 webserver.cc:460] Webserver started at http://127.0.0.1:40547/ using document root <none> and password file <none>
I20260620 22:07:52.405339 22557 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:52.405381 22557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:52.405462 22557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:52.406447 22557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "1ce5264135ce48099f6027fb617c5db8"
format_stamp: "Formatted at 2026-06-20 22:07:52 on dist-test-slave-xw35"
server_key: "52752927cbb1c543499788d77c2745dc"
server_key_iv: "7ef065aa30e0d205138325fd7996dfd6"
server_key_version: "encryptionkey@0"
I20260620 22:07:52.406730 22557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "1ce5264135ce48099f6027fb617c5db8"
format_stamp: "Formatted at 2026-06-20 22:07:52 on dist-test-slave-xw35"
server_key: "52752927cbb1c543499788d77c2745dc"
server_key_iv: "7ef065aa30e0d205138325fd7996dfd6"
server_key_version: "encryptionkey@0"
I20260620 22:07:52.407941 22557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:07:52.408571 22572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:52.408751 22557 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:52.408849 22557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "1ce5264135ce48099f6027fb617c5db8"
format_stamp: "Formatted at 2026-06-20 22:07:52 on dist-test-slave-xw35"
server_key: "52752927cbb1c543499788d77c2745dc"
server_key_iv: "7ef065aa30e0d205138325fd7996dfd6"
server_key_version: "encryptionkey@0"
I20260620 22:07:52.408926 22557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:52.439334 22557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:52.441021 22557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:52.441177 22557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:52.444859 22557 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44811
I20260620 22:07:52.444891 22624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44811 every 8 connection(s)
I20260620 22:07:52.445209 22557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:52.446054 22625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:52.448190 22625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8: Bootstrap starting.
I20260620 22:07:52.448745 22625 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:52.449043 22625 log.cc:824] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:52.449683 22625 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8: No bootstrap required, opened a new log
I20260620 22:07:52.451133 22625 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5264135ce48099f6027fb617c5db8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44811 } }
I20260620 22:07:52.451256 22625 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:52.451323 22625 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ce5264135ce48099f6027fb617c5db8, State: Initialized, Role: FOLLOWER
I20260620 22:07:52.451484 22625 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5264135ce48099f6027fb617c5db8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44811 } }
I20260620 22:07:52.451545 22625 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:52.451565 22625 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:52.451627 22625 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:52.451828 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 22557
I20260620 22:07:52.451941 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:52.452139 1247 external_mini_cluster.cc:1428] Setting key 785f030de19bef6963bda2fd560d6ff6
I20260620 22:07:52.452262 22625 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5264135ce48099f6027fb617c5db8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44811 } }
I20260620 22:07:52.452389 22625 leader_election.cc:302] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ce5264135ce48099f6027fb617c5db8; no voters:
I20260620 22:07:52.452569 22625 leader_election.cc:288] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:52.452597 22628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:52.452759 22628 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [term 1 LEADER]: Becoming Leader. State: Replica: 1ce5264135ce48099f6027fb617c5db8, State: Running, Role: LEADER
I20260620 22:07:52.452837 22625 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:52.453526 22628 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5264135ce48099f6027fb617c5db8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44811 } }
I20260620 22:07:52.454064 22631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ce5264135ce48099f6027fb617c5db8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5264135ce48099f6027fb617c5db8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44811 } } }
I20260620 22:07:52.454182 22631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:52.454342 22632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ce5264135ce48099f6027fb617c5db8. Latest consensus state: current_term: 1 leader_uuid: "1ce5264135ce48099f6027fb617c5db8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5264135ce48099f6027fb617c5db8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44811 } } }
I20260620 22:07:52.454852 22632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8 [sys.catalog]: This master's current role is: LEADER
W20260620 22:07:52.454901 22644 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:07:52.454977 22644 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:07:52.455073 22646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:52.455287 22646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:52.456770 22646 catalog_manager.cc:1347] Generated new cluster ID: eb396be2443f40a68af53bb2f7c26818
I20260620 22:07:52.456877 22646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:52.458443 22630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:52.452630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:43293 (local address 127.0.0.1:44811)
0620 22:07:52.452826 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:52.452834 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:52.452865 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:07:52.452970 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:52.452976 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:52.453030 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:52.453195 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:52.453459 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:52.455038 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:52.456113 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:52.456674 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:52.456810 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:52.457631 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:52.457634 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:52.457635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:52.457825 (+ 190us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:52.457862 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:52.457876 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:52.457967 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:52.458192 (+ 225us) server_negotiation.cc:299] Negotiation successful
0620 22:07:52.458221 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":71,"threads_started":1}
I20260620 22:07:52.459316 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:52.464533 22630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:52.460752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:54897 (local address 127.0.0.1:44811)
0620 22:07:52.460780 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:52.460782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:52.460920 (+ 138us) server_negotiation.cc:407] Connection header received
0620 22:07:52.460962 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:52.460963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:52.460974 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:52.461031 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:52.461157 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:52.462244 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:52.463201 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:52.463516 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:52.463586 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:52.464274 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:52.464276 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:52.464276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:52.464281 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:52.464295 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:52.464299 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:52.464391 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:52.464451 (+ 60us) server_negotiation.cc:299] Negotiation successful
0620 22:07:52.464462 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:07:52.483350 22646 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:52.484028 22646 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:52.489511 22646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ce5264135ce48099f6027fb617c5db8: Generated new TSK 0
I20260620 22:07:52.489672 22646 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:52.492848 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 22557
W20260620 22:07:52.497560 22542 connection.cc:535] client connection to 127.0.0.1:44811 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44811): Connection reset by peer (error 104)
2026-06-20T22:07:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1295 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:52 dist-test-slave-xw35 krb5kdc[22657](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:52 dist-test-slave-xw35 krb5kdc[22657](info): set up 2 sockets
Jun 20 22:07:52 dist-test-slave-xw35 krb5kdc[22657](info): commencing operation
krb5kdc: starting...
W20260620 22:07:53.481817 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.971s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:53 dist-test-slave-xw35 krb5kdc[22657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260620 22:07:53.589169 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39405
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:53.664494 22670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:53.664707 22670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:53.664745 22670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:53.665874 22670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:53.665941 22670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:53.665966 22670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:53.665997 22670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:53.666023 22670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:53.667467 22670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39405
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:53.667730 22670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:53.667963 22670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:53.672596 22678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:53.672618 22676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:53.672773 22675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:53.672822 22670 server_base.cc:1034] running on GCE node
I20260620 22:07:53.673020 22670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:53.673274 22670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:53.674413 22670 hybrid_clock.cc:648] HybridClock initialized: now 1781993273674384 us; error 51 us; skew 500 ppm
Jun 20 22:07:53 dist-test-slave-xw35 krb5kdc[22657](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993273, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:53.676537 22670 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260620 22:07:53.676968 22670 webserver.cc:460] Webserver started at http://127.0.0.1:37149/ using document root <none> and password file <none>
I20260620 22:07:53.677181 22670 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:53.677240 22670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:53.677379 22670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:53.678396 22670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "d45f0571403741619e03b0b68a340d24"
format_stamp: "Formatted at 2026-06-20 22:07:53 on dist-test-slave-xw35"
server_key: "80de77daa5fe4351f6b21f23499887f8"
server_key_iv: "9b167f9bb05ed510a0391ffee624dd41"
server_key_version: "encryptionkey@0"
I20260620 22:07:53.678750 22670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "d45f0571403741619e03b0b68a340d24"
format_stamp: "Formatted at 2026-06-20 22:07:53 on dist-test-slave-xw35"
server_key: "80de77daa5fe4351f6b21f23499887f8"
server_key_iv: "9b167f9bb05ed510a0391ffee624dd41"
server_key_version: "encryptionkey@0"
I20260620 22:07:53.680022 22670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260620 22:07:53.680734 22685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:53.680912 22670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:53.681005 22670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "d45f0571403741619e03b0b68a340d24"
format_stamp: "Formatted at 2026-06-20 22:07:53 on dist-test-slave-xw35"
server_key: "80de77daa5fe4351f6b21f23499887f8"
server_key_iv: "9b167f9bb05ed510a0391ffee624dd41"
server_key_version: "encryptionkey@0"
I20260620 22:07:53.681126 22670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:53.684283 22670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:53.685920 22670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:53.686066 22670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:53.689990 22670 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39405
I20260620 22:07:53.690016 22737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39405 every 8 connection(s)
I20260620 22:07:53.690296 22670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:53.691145 22738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:53.692766 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 22670
I20260620 22:07:53.692921 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:53.693097 1247 external_mini_cluster.cc:1428] Setting key aaf45df08fd4697bdc98350963b2add2
I20260620 22:07:53.693338 22738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24: Bootstrap starting.
I20260620 22:07:53.694094 22738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:53.694408 22738 log.cc:824] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:53.695385 22738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24: No bootstrap required, opened a new log
I20260620 22:07:53.695588 22741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:53.693583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:48983 (local address 127.0.0.1:39405)
0620 22:07:53.693769 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:53.693778 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:53.693814 (+ 36us) server_negotiation.cc:407] Connection header received
0620 22:07:53.694431 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:53.694439 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:53.694473 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:53.694619 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:53.695199 (+ 580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:53.695202 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:53.695202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:53.695206 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:53.695247 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:53.695259 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:53.695356 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:53.695385 (+ 29us) server_negotiation.cc:299] Negotiation successful
0620 22:07:53.695420 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":76,"threads_started":1}
I20260620 22:07:53.696533 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:53.697798 22738 raft_consensus.cc:348] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d45f0571403741619e03b0b68a340d24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260620 22:07:53.697962 22738 raft_consensus.cc:374] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:53.697999 22738 raft_consensus.cc:729] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d45f0571403741619e03b0b68a340d24, State: Initialized, Role: FOLLOWER
I20260620 22:07:53.698176 22738 consensus_queue.cc:260] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d45f0571403741619e03b0b68a340d24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260620 22:07:53.698295 22738 raft_consensus.cc:388] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:53.698333 22738 raft_consensus.cc:482] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:53.698397 22738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:53.699106 22741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:53.698106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.255:56601 (local address 127.0.0.1:39405)
0620 22:07:53.698143 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:53.698146 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:53.698251 (+ 105us) server_negotiation.cc:407] Connection header received
0620 22:07:53.698307 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:53.698308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:53.698312 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:53.698364 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:53.698900 (+ 536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:53.698901 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:53.698901 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:53.698904 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:53.698916 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:53.698919 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:53.698958 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:53.699018 (+ 60us) server_negotiation.cc:299] Negotiation successful
0620 22:07:53.699028 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:07:53.699122 22738 raft_consensus.cc:504] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d45f0571403741619e03b0b68a340d24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260620 22:07:53.699299 22738 leader_election.cc:302] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d45f0571403741619e03b0b68a340d24; no voters:
I20260620 22:07:53.699450 22738 leader_election.cc:288] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:53.699470 22748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:53.699628 22748 raft_consensus.cc:686] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [term 1 LEADER]: Becoming Leader. State: Replica: d45f0571403741619e03b0b68a340d24, State: Running, Role: LEADER
I20260620 22:07:53.699731 22738 sys_catalog.cc:564] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:53.699774 22748 consensus_queue.cc:237] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d45f0571403741619e03b0b68a340d24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } }
I20260620 22:07:53.700192 22750 sys_catalog.cc:455] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d45f0571403741619e03b0b68a340d24. Latest consensus state: current_term: 1 leader_uuid: "d45f0571403741619e03b0b68a340d24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d45f0571403741619e03b0b68a340d24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } } }
I20260620 22:07:53.700208 22749 sys_catalog.cc:455] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d45f0571403741619e03b0b68a340d24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d45f0571403741619e03b0b68a340d24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39405 } } }
I20260620 22:07:53.700430 22750 sys_catalog.cc:458] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:53.700433 22749 sys_catalog.cc:458] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:53.700675 22757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:53.701129 22757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:53.702596 22757 catalog_manager.cc:1347] Generated new cluster ID: fad08b5dd7f24d3a8fd7362f78c4c0b1
I20260620 22:07:53.702651 22757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:53.719837 22757 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:53.719976 22757 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:53.734040 22757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d45f0571403741619e03b0b68a340d24: Generated new TSK 0
I20260620 22:07:53.734207 22757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:53.737542 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 22670
2026-06-20T22:07:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1244 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:53 dist-test-slave-xw35 krb5kdc[22769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:53 dist-test-slave-xw35 krb5kdc[22769](info): set up 2 sockets
Jun 20 22:07:53 dist-test-slave-xw35 krb5kdc[22769](info): commencing operation
krb5kdc: starting...
W20260620 22:07:54.729614 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.974s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:54 dist-test-slave-xw35 krb5kdc[22769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:07:54.838294 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:43867
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:39191
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:43867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:54.913316 22782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:54.913595 22782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:54.913632 22782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:54.914737 22782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:54.914824 22782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:54.914846 22782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:54.914873 22782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:54.914898 22782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:54.916200 22782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:39191
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:43867
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:43867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:54.916440 22782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:54.916642 22782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:54.921039 22788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:54.921063 22787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:54.921038 22790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:54.921104 22782 server_base.cc:1034] running on GCE node
I20260620 22:07:54.921407 22782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:54.921694 22782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:54.922828 22782 hybrid_clock.cc:648] HybridClock initialized: now 1781993274922822 us; error 29 us; skew 500 ppm
Jun 20 22:07:54 dist-test-slave-xw35 krb5kdc[22769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993274, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:54.924996 22782 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:54.925400 22782 webserver.cc:460] Webserver started at http://127.1.55.254:39645/ using document root <none> and password file <none>
I20260620 22:07:54.925613 22782 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:54.925653 22782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:54.925791 22782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:54.926769 22782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "2eb77649c76747ffa20972916448b1ae"
format_stamp: "Formatted at 2026-06-20 22:07:54 on dist-test-slave-xw35"
server_key: "a4c36cda462d17373e78ced697dc09b1"
server_key_iv: "58113b8e1e2551e60f6e9da58f4347c5"
server_key_version: "encryptionkey@0"
I20260620 22:07:54.927105 22782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "2eb77649c76747ffa20972916448b1ae"
format_stamp: "Formatted at 2026-06-20 22:07:54 on dist-test-slave-xw35"
server_key: "a4c36cda462d17373e78ced697dc09b1"
server_key_iv: "58113b8e1e2551e60f6e9da58f4347c5"
server_key_version: "encryptionkey@0"
I20260620 22:07:54.928375 22782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:54.929071 22797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:54.929206 22782 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:54.929277 22782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "2eb77649c76747ffa20972916448b1ae"
format_stamp: "Formatted at 2026-06-20 22:07:54 on dist-test-slave-xw35"
server_key: "a4c36cda462d17373e78ced697dc09b1"
server_key_iv: "58113b8e1e2551e60f6e9da58f4347c5"
server_key_version: "encryptionkey@0"
I20260620 22:07:54.929332 22782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:54.936393 22782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:54.938496 22782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:54.938598 22782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:54.941934 22782 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:43867
I20260620 22:07:54.941974 22849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:43867 every 8 connection(s)
I20260620 22:07:54.942250 22782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:54.943099 22850 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:54.944991 22850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae: Bootstrap starting.
I20260620 22:07:54.945616 22850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:54.945878 22850 log.cc:824] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:54.946470 22850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae: No bootstrap required, opened a new log
I20260620 22:07:54.947885 22850 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb77649c76747ffa20972916448b1ae" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43867 } }
I20260620 22:07:54.948030 22850 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:54.948071 22850 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2eb77649c76747ffa20972916448b1ae, State: Initialized, Role: FOLLOWER
I20260620 22:07:54.948239 22850 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb77649c76747ffa20972916448b1ae" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43867 } }
I20260620 22:07:54.948333 22850 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:54.948371 22850 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:54.948426 22850 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:54.949198 22850 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb77649c76747ffa20972916448b1ae" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43867 } }
I20260620 22:07:54.949311 22850 leader_election.cc:302] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2eb77649c76747ffa20972916448b1ae; no voters:
I20260620 22:07:54.949508 22850 leader_election.cc:288] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:54.949555 22853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:54.949699 22853 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [term 1 LEADER]: Becoming Leader. State: Replica: 2eb77649c76747ffa20972916448b1ae, State: Running, Role: LEADER
I20260620 22:07:54.949751 22850 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:54.949878 22853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb77649c76747ffa20972916448b1ae" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43867 } }
I20260620 22:07:54.950237 22855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2eb77649c76747ffa20972916448b1ae. Latest consensus state: current_term: 1 leader_uuid: "2eb77649c76747ffa20972916448b1ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb77649c76747ffa20972916448b1ae" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43867 } } }
I20260620 22:07:54.950356 22855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:54.950233 22854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2eb77649c76747ffa20972916448b1ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb77649c76747ffa20972916448b1ae" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 43867 } } }
I20260620 22:07:54.950763 22854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:54.950847 22862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:54.951231 22862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:54.951932 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 22782
I20260620 22:07:54.952047 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:54.952232 1247 external_mini_cluster.cc:1428] Setting key 8ee946f06c073d1d1452e4fcbdf6239b
I20260620 22:07:54.952924 22862 catalog_manager.cc:1347] Generated new cluster ID: ccc135618b474927b2272a2ecca7fbc6
I20260620 22:07:54.953004 22862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Jun 20 22:07:54 dist-test-slave-xw35 krb5kdc[22769](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:07:54.964178 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:54.952660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44961 (local address 127.1.55.254:43867)
0620 22:07:54.953801 (+ 1141us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:54.953809 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:54.953838 (+ 29us) server_negotiation.cc:407] Connection header received
0620 22:07:54.953950 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:54.953957 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:54.954005 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:54.954876 (+ 871us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:54.954958 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:54.956334 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:54.957279 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:54.957870 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:54.958218 (+ 348us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:54.960533 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:54.960537 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:54.960538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:54.960548 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:54.962440 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:54.962856 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:54.962859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:54.962859 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:54.962977 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:54.963155 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:54.963156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:54.963156 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:54.963425 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:54.963848 (+ 423us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:54.963912 (+ 64us) server_negotiation.cc:299] Negotiation successful
0620 22:07:54.963990 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1061,"thread_start_us":66,"threads_started":1}
I20260620 22:07:54.965049 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:54.969827 22862 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:54.970547 22862 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:54.974906 22862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2eb77649c76747ffa20972916448b1ae: Generated new TSK 0
I20260620 22:07:54.975042 22862 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:54.976073 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:54.966319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53343 (local address 127.1.55.254:43867)
0620 22:07:54.966351 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:54.966353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:54.969634 (+ 3281us) server_negotiation.cc:407] Connection header received
0620 22:07:54.969733 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:54.969734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:54.969743 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:54.969782 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:54.970425 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:54.971197 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:54.972105 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:54.972387 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:54.972451 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:54.973572 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:54.973574 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:54.973574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:54.973580 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:54.975034 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:54.975383 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:54.975384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:54.975385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:54.975435 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:54.975645 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:54.975646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:54.975646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:54.975765 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:54.975850 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:54.975941 (+ 91us) server_negotiation.cc:299] Negotiation successful
0620 22:07:54.975997 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:07:54.978022 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 22782
W20260620 22:07:54.982260 22767 connection.cc:535] client connection to 127.1.55.254:43867 recv error: Network error: failed to read from TLS socket (remote: 127.1.55.254:43867): Connection reset by peer (error 104)
2026-06-20T22:07:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1240 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:55 dist-test-slave-xw35 krb5kdc[22881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:55 dist-test-slave-xw35 krb5kdc[22881](info): set up 2 sockets
Jun 20 22:07:55 dist-test-slave-xw35 krb5kdc[22881](info): commencing operation
krb5kdc: starting...
W20260620 22:07:55.977234 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.982s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:56 dist-test-slave-xw35 krb5kdc[22881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:07:56.088407 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:34489
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:39211
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:34489
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:56.164371 22894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:56.164582 22894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:56.164618 22894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:56.165755 22894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:56.165827 22894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:56.165853 22894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:56.165886 22894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:56.165910 22894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:56.167245 22894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:39211
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:34489
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:34489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:56.167541 22894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:56.167764 22894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:56.172181 22899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:56.172267 22894 server_base.cc:1034] running on GCE node
W20260620 22:07:56.172209 22900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:56.172228 22902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:56.172622 22894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:56.172894 22894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:56.174054 22894 hybrid_clock.cc:648] HybridClock initialized: now 1781993276174045 us; error 37 us; skew 500 ppm
Jun 20 22:07:56 dist-test-slave-xw35 krb5kdc[22881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993276, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:56.181897 22894 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:56.182351 22894 webserver.cc:460] Webserver started at http://127.1.55.254:40073/ using document root <none> and password file <none>
I20260620 22:07:56.182559 22894 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:56.182622 22894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:56.182775 22894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:56.183740 22894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "f66d906ea34940e582fb7983bceed9d1"
format_stamp: "Formatted at 2026-06-20 22:07:56 on dist-test-slave-xw35"
server_key: "dff742b2b5f610ed3bec3de1df428cfa"
server_key_iv: "272f693c9725a1851dc37fa2bbead4f8"
server_key_version: "encryptionkey@0"
I20260620 22:07:56.184103 22894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "f66d906ea34940e582fb7983bceed9d1"
format_stamp: "Formatted at 2026-06-20 22:07:56 on dist-test-slave-xw35"
server_key: "dff742b2b5f610ed3bec3de1df428cfa"
server_key_iv: "272f693c9725a1851dc37fa2bbead4f8"
server_key_version: "encryptionkey@0"
I20260620 22:07:56.185408 22894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:56.186174 22909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:56.186362 22894 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:56.186456 22894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "f66d906ea34940e582fb7983bceed9d1"
format_stamp: "Formatted at 2026-06-20 22:07:56 on dist-test-slave-xw35"
server_key: "dff742b2b5f610ed3bec3de1df428cfa"
server_key_iv: "272f693c9725a1851dc37fa2bbead4f8"
server_key_version: "encryptionkey@0"
I20260620 22:07:56.186534 22894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:56.201275 22894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:56.203114 22894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:56.203259 22894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:56.207180 22894 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:34489
I20260620 22:07:56.207211 22961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:34489 every 8 connection(s)
I20260620 22:07:56.207568 22894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:56.208333 22962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:56.210448 22962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1: Bootstrap starting.
I20260620 22:07:56.210963 22962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:56.211210 22962 log.cc:824] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:56.211845 22962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1: No bootstrap required, opened a new log
I20260620 22:07:56.212533 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 22894
I20260620 22:07:56.212636 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:56.212811 1247 external_mini_cluster.cc:1428] Setting key f5dd68989fdc3ac711c617cbf568a6d0
I20260620 22:07:56.213828 22962 raft_consensus.cc:348] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66d906ea34940e582fb7983bceed9d1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 34489 } }
I20260620 22:07:56.213999 22962 raft_consensus.cc:374] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:56.214035 22962 raft_consensus.cc:729] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f66d906ea34940e582fb7983bceed9d1, State: Initialized, Role: FOLLOWER
I20260620 22:07:56.214152 22962 consensus_queue.cc:260] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66d906ea34940e582fb7983bceed9d1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 34489 } }
I20260620 22:07:56.214234 22962 raft_consensus.cc:388] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:56.214257 22962 raft_consensus.cc:482] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:56.214316 22962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:56.214788 22962 raft_consensus.cc:504] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66d906ea34940e582fb7983bceed9d1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 34489 } }
I20260620 22:07:56.214861 22962 leader_election.cc:302] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f66d906ea34940e582fb7983bceed9d1; no voters:
I20260620 22:07:56.215047 22962 leader_election.cc:288] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:56.215085 22967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:56.215229 22967 raft_consensus.cc:686] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [term 1 LEADER]: Becoming Leader. State: Replica: f66d906ea34940e582fb7983bceed9d1, State: Running, Role: LEADER
I20260620 22:07:56.215273 22962 sys_catalog.cc:564] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:56.215340 22967 consensus_queue.cc:237] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66d906ea34940e582fb7983bceed9d1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 34489 } }
I20260620 22:07:56.215652 22967 sys_catalog.cc:455] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f66d906ea34940e582fb7983bceed9d1. Latest consensus state: current_term: 1 leader_uuid: "f66d906ea34940e582fb7983bceed9d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66d906ea34940e582fb7983bceed9d1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 34489 } } }
I20260620 22:07:56.215772 22967 sys_catalog.cc:458] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:56.215991 22975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:56.216480 22975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:56.216889 22969 sys_catalog.cc:455] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f66d906ea34940e582fb7983bceed9d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66d906ea34940e582fb7983bceed9d1" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 34489 } } }
I20260620 22:07:56.216964 22969 sys_catalog.cc:458] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:56.218204 22975 catalog_manager.cc:1347] Generated new cluster ID: 2218241d82c64305af97bf7cdfd02b96
I20260620 22:07:56.218255 22975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:56.218989 22966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:56.213250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50019 (local address 127.1.55.254:34489)
0620 22:07:56.213424 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:56.213430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:56.213452 (+ 22us) server_negotiation.cc:407] Connection header received
0620 22:07:56.213770 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:56.213775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:56.213832 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:56.213941 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:56.214178 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:56.215560 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:56.216724 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:56.217343 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:56.217440 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:56.218287 (+ 847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:56.218290 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:56.218290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:56.218509 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:56.218545 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:56.218559 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:56.218654 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:56.218751 (+ 97us) server_negotiation.cc:299] Negotiation successful
0620 22:07:56.218780 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
I20260620 22:07:56.219934 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:56.224519 22966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:56.221314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56079 (local address 127.1.55.254:34489)
0620 22:07:56.221343 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:56.221345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:56.221352 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:07:56.221397 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:56.221398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:56.221406 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:56.221454 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:56.221581 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:56.222286 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:56.223240 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:56.223573 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:56.223647 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:56.224292 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:56.224293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:56.224293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:56.224297 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:56.224309 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:56.224313 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:56.224383 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:56.224444 (+ 61us) server_negotiation.cc:299] Negotiation successful
0620 22:07:56.224456 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:07:56.237568 22975 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:56.238132 22975 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:56.240020 22975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f66d906ea34940e582fb7983bceed9d1: Generated new TSK 0
I20260620 22:07:56.240171 22975 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:56.246484 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 22894
W20260620 22:07:56.250905 22879 connection.cc:535] client connection to 127.1.55.254:34489 recv error: Network error: failed to read from TLS socket (remote: 127.1.55.254:34489): Connection reset by peer (error 104)
2026-06-20T22:07:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1268 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:56 dist-test-slave-xw35 krb5kdc[22993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:56 dist-test-slave-xw35 krb5kdc[22993](info): set up 2 sockets
Jun 20 22:07:56 dist-test-slave-xw35 krb5kdc[22993](info): commencing operation
krb5kdc: starting...
W20260620 22:07:57.241394 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.977s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:57 dist-test-slave-xw35 krb5kdc[22993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993277, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:07:57.346383 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42825
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:45747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:42825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:57.422686 23006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:57.422887 23006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:57.422920 23006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:57.423930 23006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:57.423993 23006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:57.424014 23006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:57.424041 23006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:57.424060 23006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:57.425423 23006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:45747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:42825
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:42825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:57.425709 23006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:57.425920 23006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:57.430399 23012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:57.430398 23014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:57.430430 23011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:57.430606 23006 server_base.cc:1034] running on GCE node
I20260620 22:07:57.430856 23006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:57.431147 23006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:57.432302 23006 hybrid_clock.cc:648] HybridClock initialized: now 1781993277432270 us; error 46 us; skew 500 ppm
Jun 20 22:07:57 dist-test-slave-xw35 krb5kdc[22993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993277, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:57.434557 23006 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:57.434957 23006 webserver.cc:460] Webserver started at http://127.1.55.254:45003/ using document root <none> and password file <none>
I20260620 22:07:57.435163 23006 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:57.435220 23006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:57.435345 23006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:57.436260 23006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "79070fee905541afb81b9db287b3e586"
format_stamp: "Formatted at 2026-06-20 22:07:57 on dist-test-slave-xw35"
server_key: "7aa9fffeeed15add11211cdf8d3b1011"
server_key_iv: "68ec855a25f751bb3d28336d047922a6"
server_key_version: "encryptionkey@0"
I20260620 22:07:57.436574 23006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "79070fee905541afb81b9db287b3e586"
format_stamp: "Formatted at 2026-06-20 22:07:57 on dist-test-slave-xw35"
server_key: "7aa9fffeeed15add11211cdf8d3b1011"
server_key_iv: "68ec855a25f751bb3d28336d047922a6"
server_key_version: "encryptionkey@0"
I20260620 22:07:57.437793 23006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:07:57.438476 23021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:57.438643 23006 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260620 22:07:57.438742 23006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "79070fee905541afb81b9db287b3e586"
format_stamp: "Formatted at 2026-06-20 22:07:57 on dist-test-slave-xw35"
server_key: "7aa9fffeeed15add11211cdf8d3b1011"
server_key_iv: "68ec855a25f751bb3d28336d047922a6"
server_key_version: "encryptionkey@0"
I20260620 22:07:57.438827 23006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:57.441749 23006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:57.443416 23006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:57.443562 23006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:57.446950 23006 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:42825
I20260620 22:07:57.446990 23073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:42825 every 8 connection(s)
I20260620 22:07:57.447268 23006 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:57.448195 23074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:57.449934 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23006
I20260620 22:07:57.450050 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:57.450217 1247 external_mini_cluster.cc:1428] Setting key 5083d5d4c4fb70f73b0b36f5a7113a3b
I20260620 22:07:57.450318 23074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586: Bootstrap starting.
I20260620 22:07:57.451004 23074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:57.451299 23074 log.cc:824] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:57.452011 23074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586: No bootstrap required, opened a new log
I20260620 22:07:57.452597 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:57.450693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39885 (local address 127.1.55.254:42825)
0620 22:07:57.450905 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:57.450919 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:57.450942 (+ 23us) server_negotiation.cc:407] Connection header received
0620 22:07:57.451428 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:57.451435 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:57.451469 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:57.451607 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:57.452220 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:57.452223 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:57.452223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:57.452228 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:57.452280 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:57.452289 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:57.452381 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:57.452412 (+ 31us) server_negotiation.cc:299] Negotiation successful
0620 22:07:57.452447 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":93,"threads_started":1}
I20260620 22:07:57.453402 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:57.454071 23074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79070fee905541afb81b9db287b3e586" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42825 } }
I20260620 22:07:57.454223 23074 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:57.454294 23074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79070fee905541afb81b9db287b3e586, State: Initialized, Role: FOLLOWER
I20260620 22:07:57.454432 23074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79070fee905541afb81b9db287b3e586" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42825 } }
I20260620 22:07:57.454542 23074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:57.454581 23074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:57.454635 23074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:57.455325 23074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79070fee905541afb81b9db287b3e586" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42825 } }
I20260620 22:07:57.455438 23074 leader_election.cc:302] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79070fee905541afb81b9db287b3e586; no voters:
I20260620 22:07:57.455597 23074 leader_election.cc:288] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:57.455675 23077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:57.454701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44735 (local address 127.1.55.254:42825)
0620 22:07:57.454734 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:57.454736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:57.454878 (+ 142us) server_negotiation.cc:407] Connection header received
0620 22:07:57.454928 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:57.454929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:57.454933 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:57.454984 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:57.455422 (+ 438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:57.455423 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:57.455423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:57.455427 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:57.455438 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:57.455442 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:57.455492 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:57.455571 (+ 79us) server_negotiation.cc:299] Negotiation successful
0620 22:07:57.455585 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:07:57.455701 23084 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:57.455793 23084 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [term 1 LEADER]: Becoming Leader. State: Replica: 79070fee905541afb81b9db287b3e586, State: Running, Role: LEADER
I20260620 22:07:57.455837 23074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:57.455894 23084 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79070fee905541afb81b9db287b3e586" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42825 } }
I20260620 22:07:57.456264 23084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79070fee905541afb81b9db287b3e586" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79070fee905541afb81b9db287b3e586" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42825 } } }
I20260620 22:07:57.456350 23084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:57.456447 23085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79070fee905541afb81b9db287b3e586. Latest consensus state: current_term: 1 leader_uuid: "79070fee905541afb81b9db287b3e586" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79070fee905541afb81b9db287b3e586" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 42825 } } }
I20260620 22:07:57.456557 23085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586 [sys.catalog]: This master's current role is: LEADER
W20260620 22:07:57.457625 23100 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:07:57.457667 23100 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:07:57.457727 23091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:57.457881 23091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:57.459127 23091 catalog_manager.cc:1347] Generated new cluster ID: 4bd4908220dd471f8e328e0793b6230d
I20260620 22:07:57.459177 23091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:57.466240 23091 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:57.466367 23091 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:57.471141 23091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79070fee905541afb81b9db287b3e586: Generated new TSK 0
I20260620 22:07:57.471331 23091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:57.473675 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23006
2026-06-20T22:07:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1226 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:57 dist-test-slave-xw35 krb5kdc[23105](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:57 dist-test-slave-xw35 krb5kdc[23105](info): set up 2 sockets
Jun 20 22:07:57 dist-test-slave-xw35 krb5kdc[23105](info): commencing operation
krb5kdc: starting...
W20260620 22:07:58.469615 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.979s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:58 dist-test-slave-xw35 krb5kdc[23105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:07:58.576305 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:41211
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:40817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:41211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:58.653733 23118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:58.653980 23118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:58.654017 23118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:58.655166 23118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:58.655237 23118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:58.655260 23118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:58.655282 23118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:58.655309 23118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:58.656728 23118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:40817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:41211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:41211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:58.657011 23118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:58.657239 23118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:58.661863 23123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:58.661993 23118 server_base.cc:1034] running on GCE node
W20260620 22:07:58.661885 23124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:58.661927 23126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:58.662312 23118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:58.662598 23118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:58.663776 23118 hybrid_clock.cc:648] HybridClock initialized: now 1781993278663757 us; error 36 us; skew 500 ppm
Jun 20 22:07:58 dist-test-slave-xw35 krb5kdc[23105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993278, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:58.666108 23118 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:58.666522 23118 webserver.cc:460] Webserver started at http://127.1.55.254:41107/ using document root <none> and password file <none>
I20260620 22:07:58.666723 23118 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:58.666785 23118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:58.666934 23118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:58.667930 23118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "22c28a2e009743dd9e11618f2b1b70d5"
format_stamp: "Formatted at 2026-06-20 22:07:58 on dist-test-slave-xw35"
server_key: "33312d8b8351d6c99d9e12e625b26270"
server_key_iv: "4d2b65de36faa818a45244116b6792eb"
server_key_version: "encryptionkey@0"
I20260620 22:07:58.668273 23118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "22c28a2e009743dd9e11618f2b1b70d5"
format_stamp: "Formatted at 2026-06-20 22:07:58 on dist-test-slave-xw35"
server_key: "33312d8b8351d6c99d9e12e625b26270"
server_key_iv: "4d2b65de36faa818a45244116b6792eb"
server_key_version: "encryptionkey@0"
I20260620 22:07:58.669565 23118 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:07:58.670258 23133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:58.670433 23118 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:58.670523 23118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "22c28a2e009743dd9e11618f2b1b70d5"
format_stamp: "Formatted at 2026-06-20 22:07:58 on dist-test-slave-xw35"
server_key: "33312d8b8351d6c99d9e12e625b26270"
server_key_iv: "4d2b65de36faa818a45244116b6792eb"
server_key_version: "encryptionkey@0"
I20260620 22:07:58.670600 23118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:58.691558 23118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:58.693291 23118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:58.693449 23118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:58.697137 23118 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:41211
I20260620 22:07:58.697196 23185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:41211 every 8 connection(s)
I20260620 22:07:58.697520 23118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:58.698290 23186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:58.700126 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23118
I20260620 22:07:58.700248 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:58.700366 23186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5: Bootstrap starting.
I20260620 22:07:58.700403 1247 external_mini_cluster.cc:1428] Setting key 191b07a1a97bfce3b7b438cc0f98485a
I20260620 22:07:58.701010 23186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:58.701277 23186 log.cc:824] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:58.702042 23186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5: No bootstrap required, opened a new log
I20260620 22:07:58.704105 23186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22c28a2e009743dd9e11618f2b1b70d5" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41211 } }
I20260620 22:07:58.704257 23186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:58.704289 23186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22c28a2e009743dd9e11618f2b1b70d5, State: Initialized, Role: FOLLOWER
I20260620 22:07:58.704414 23186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22c28a2e009743dd9e11618f2b1b70d5" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41211 } }
I20260620 22:07:58.704501 23186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:58.704543 23186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:58.704591 23186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:58.705163 23186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22c28a2e009743dd9e11618f2b1b70d5" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41211 } }
I20260620 22:07:58.705272 23186 leader_election.cc:302] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22c28a2e009743dd9e11618f2b1b70d5; no voters:
I20260620 22:07:58.705423 23186 leader_election.cc:288] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:58.705556 23191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:58.705725 23191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [term 1 LEADER]: Becoming Leader. State: Replica: 22c28a2e009743dd9e11618f2b1b70d5, State: Running, Role: LEADER
I20260620 22:07:58.705737 23186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:58.705847 23191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22c28a2e009743dd9e11618f2b1b70d5" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41211 } }
I20260620 22:07:58.706184 23192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22c28a2e009743dd9e11618f2b1b70d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22c28a2e009743dd9e11618f2b1b70d5" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41211 } } }
I20260620 22:07:58.706182 23193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22c28a2e009743dd9e11618f2b1b70d5. Latest consensus state: current_term: 1 leader_uuid: "22c28a2e009743dd9e11618f2b1b70d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22c28a2e009743dd9e11618f2b1b70d5" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 41211 } } }
I20260620 22:07:58.706279 23192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:58.706282 23193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5 [sys.catalog]: This master's current role is: LEADER
Jun 20 22:07:58 dist-test-slave-xw35 krb5kdc[23105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
W20260620 22:07:58.707664 23207 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:07:58.707726 23207 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:07:58.707823 23198 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:58.708042 23198 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:58.709581 23198 catalog_manager.cc:1347] Generated new cluster ID: c0bc7d56e8af44e28236553697a62532
I20260620 22:07:58.709628 23198 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:58.711742 23189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:58.700885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36717 (local address 127.1.55.254:41211)
0620 22:07:58.701049 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:58.701056 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:58.701098 (+ 42us) server_negotiation.cc:407] Connection header received
0620 22:07:58.701627 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:58.701634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:58.701678 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:58.701806 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:58.702540 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:58.703369 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:58.704451 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:58.704916 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:58.704993 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:58.708022 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:58.708026 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:58.708027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:58.708038 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:58.710077 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:58.710439 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:58.710442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:58.710442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:58.710540 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:58.710698 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:58.710698 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:58.710698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:58.710940 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:58.711058 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:58.711441 (+ 383us) server_negotiation.cc:299] Negotiation successful
0620 22:07:58.711553 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260620 22:07:58.712733 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:58.720135 23198 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:58.720705 23198 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:58.724401 23189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:58.717767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37127 (local address 127.1.55.254:41211)
0620 22:07:58.717804 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:58.717806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:58.717896 (+ 90us) server_negotiation.cc:407] Connection header received
0620 22:07:58.717950 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:58.717950 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:58.717959 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:58.718032 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:58.718598 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:58.719324 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:58.720142 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:58.720452 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:58.720524 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:58.721837 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:58.721838 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:58.721839 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:07:58.721845 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:58.723357 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:58.723701 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:58.723702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:58.723703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:58.723757 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:07:58.723938 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:07:58.723939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:07:58.723940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:07:58.724053 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:58.724144 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:58.724241 (+ 97us) server_negotiation.cc:299] Negotiation successful
0620 22:07:58.724319 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:07:58.732345 23198 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22c28a2e009743dd9e11618f2b1b70d5: Generated new TSK 0
I20260620 22:07:58.732499 23198 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:07:58.738652 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23118
2026-06-20T22:07:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1265 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:07:58 dist-test-slave-xw35 krb5kdc[23217](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:07:58 dist-test-slave-xw35 krb5kdc[23217](info): set up 2 sockets
Jun 20 22:07:58 dist-test-slave-xw35 krb5kdc[23217](info): commencing operation
krb5kdc: starting...
W20260620 22:07:59.761576 1247 mini_kdc.cc:121] Time spent starting KDC: real 1.005s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:07:59 dist-test-slave-xw35 krb5kdc[23217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:07:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:07:59.867883 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45901
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:38107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:07:59.942600 23230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:07:59.942811 23230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:07:59.942845 23230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:07:59.943889 23230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:07:59.943957 23230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:07:59.943979 23230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:07:59.943998 23230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:07:59.944023 23230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:07:59.945349 23230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:38107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:07:59.945605 23230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:07:59.945807 23230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:07:59.950196 23236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:59.950208 23235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:07:59.950227 23238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:07:59.950551 23230 server_base.cc:1034] running on GCE node
I20260620 22:07:59.950765 23230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:07:59.951074 23230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:07:59.952209 23230 hybrid_clock.cc:648] HybridClock initialized: now 1781993279952197 us; error 29 us; skew 500 ppm
Jun 20 22:07:59 dist-test-slave-xw35 krb5kdc[23217](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993279, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:07:59.954536 23230 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:07:59.954907 23230 webserver.cc:460] Webserver started at http://127.1.55.254:36271/ using document root <none> and password file <none>
I20260620 22:07:59.955129 23230 fs_manager.cc:359] Metadata directory not provided
I20260620 22:07:59.955169 23230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:07:59.955363 23230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:07:59.956229 23230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "828b908be5e14cb8be08b7f019d5f095"
format_stamp: "Formatted at 2026-06-20 22:07:59 on dist-test-slave-xw35"
server_key: "378eb400415230d10cd5e52a8901a2ca"
server_key_iv: "09b6742e43ca7589db1ca46689a3c518"
server_key_version: "encryptionkey@0"
I20260620 22:07:59.956565 23230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "828b908be5e14cb8be08b7f019d5f095"
format_stamp: "Formatted at 2026-06-20 22:07:59 on dist-test-slave-xw35"
server_key: "378eb400415230d10cd5e52a8901a2ca"
server_key_iv: "09b6742e43ca7589db1ca46689a3c518"
server_key_version: "encryptionkey@0"
I20260620 22:07:59.957746 23230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:07:59.958452 23245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:07:59.958619 23230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:07:59.958716 23230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "828b908be5e14cb8be08b7f019d5f095"
format_stamp: "Formatted at 2026-06-20 22:07:59 on dist-test-slave-xw35"
server_key: "378eb400415230d10cd5e52a8901a2ca"
server_key_iv: "09b6742e43ca7589db1ca46689a3c518"
server_key_version: "encryptionkey@0"
I20260620 22:07:59.958791 23230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:07:59.966548 23230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:07:59.968670 23230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:07:59.968818 23230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:07:59.972486 23230 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:45901
I20260620 22:07:59.972513 23297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:45901 every 8 connection(s)
I20260620 22:07:59.972790 23230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:07:59.973620 23298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:07:59.975512 23298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095: Bootstrap starting.
I20260620 22:07:59.976028 23298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095: Neither blocks nor log segments found. Creating new log.
I20260620 22:07:59.976307 23298 log.cc:824] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095: Log is configured to *not* fsync() on all Append() calls
I20260620 22:07:59.976959 23298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095: No bootstrap required, opened a new log
I20260620 22:07:59.978544 23298 raft_consensus.cc:348] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "828b908be5e14cb8be08b7f019d5f095" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45901 } }
I20260620 22:07:59.978667 23298 raft_consensus.cc:374] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:07:59.978713 23298 raft_consensus.cc:729] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828b908be5e14cb8be08b7f019d5f095, State: Initialized, Role: FOLLOWER
I20260620 22:07:59.978876 23298 consensus_queue.cc:260] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "828b908be5e14cb8be08b7f019d5f095" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45901 } }
I20260620 22:07:59.978936 23298 raft_consensus.cc:388] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:07:59.978957 23298 raft_consensus.cc:482] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:07:59.979022 23298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:07:59.979835 23298 raft_consensus.cc:504] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "828b908be5e14cb8be08b7f019d5f095" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45901 } }
I20260620 22:07:59.979957 23298 leader_election.cc:302] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 828b908be5e14cb8be08b7f019d5f095; no voters:
I20260620 22:07:59.980135 23298 leader_election.cc:288] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:07:59.980162 23301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:07:59.980314 23301 raft_consensus.cc:686] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [term 1 LEADER]: Becoming Leader. State: Replica: 828b908be5e14cb8be08b7f019d5f095, State: Running, Role: LEADER
I20260620 22:07:59.980365 23298 sys_catalog.cc:564] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:07:59.980443 23301 consensus_queue.cc:237] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "828b908be5e14cb8be08b7f019d5f095" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45901 } }
I20260620 22:07:59.980762 23302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "828b908be5e14cb8be08b7f019d5f095" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "828b908be5e14cb8be08b7f019d5f095" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45901 } } }
I20260620 22:07:59.980765 23303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 828b908be5e14cb8be08b7f019d5f095. Latest consensus state: current_term: 1 leader_uuid: "828b908be5e14cb8be08b7f019d5f095" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "828b908be5e14cb8be08b7f019d5f095" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45901 } } }
I20260620 22:07:59.980952 23303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:59.980885 23302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095 [sys.catalog]: This master's current role is: LEADER
I20260620 22:07:59.981290 23310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:07:59.981648 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23230
I20260620 22:07:59.981755 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:07:59.981797 23310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:07:59.981937 1247 external_mini_cluster.cc:1428] Setting key 1da49e2a6b781afb26ffcf00a32b88e0
I20260620 22:07:59.983315 23310 catalog_manager.cc:1347] Generated new cluster ID: 3a1861b75ae0445b81571b84806c7bc6
I20260620 22:07:59.983378 23310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:07:59.987066 23310 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:07:59.987507 23310 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:07:59.988065 23320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:59.982465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59109 (local address 127.1.55.254:45901)
0620 22:07:59.982637 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:59.982646 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:59.982857 (+ 211us) server_negotiation.cc:407] Connection header received
0620 22:07:59.983005 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:59.983012 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:59.983061 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:59.983451 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:59.983547 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:59.984845 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:59.985919 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:59.986500 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:59.986604 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:59.987200 (+ 596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:59.987203 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:59.987204 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:59.987396 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:59.987438 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:59.987450 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:59.987720 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:59.987769 (+ 49us) server_negotiation.cc:299] Negotiation successful
0620 22:07:59.987860 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260620 22:07:59.988910 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:07:59.993528 23320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:07:59.990394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46809 (local address 127.1.55.254:45901)
0620 22:07:59.990428 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0620 22:07:59.990430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:07:59.990439 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:07:59.990494 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:07:59.990495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:07:59.990505 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:07:59.990566 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:07:59.990686 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:59.991427 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:59.992370 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:07:59.992650 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:07:59.992721 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:07:59.993291 (+ 570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:07:59.993292 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:07:59.993293 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:07:59.993297 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:07:59.993316 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:07:59.993320 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:07:59.993372 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0620 22:07:59.993428 (+ 56us) server_negotiation.cc:299] Negotiation successful
0620 22:07:59.993449 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:07:59.995831 23310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 828b908be5e14cb8be08b7f019d5f095: Generated new TSK 0
I20260620 22:07:59.995975 23310 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:08:00.000710 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23230
2026-06-20T22:07:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1261 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:08:00 dist-test-slave-xw35 krb5kdc[23329](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:08:00 dist-test-slave-xw35 krb5kdc[23329](info): set up 2 sockets
Jun 20 22:08:00 dist-test-slave-xw35 krb5kdc[23329](info): commencing operation
krb5kdc: starting...
W20260620 22:08:00.997105 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.980s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:08:01 dist-test-slave-xw35 krb5kdc[23329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:08:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:08:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:08:01.102391 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:39777
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:38379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:39777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:08:01.176637 23342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:08:01.176812 23342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:08:01.176833 23342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:08:01.177976 23342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:08:01.178016 23342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:08:01.178030 23342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:08:01.178042 23342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:08:01.178092 23342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:08:01.179558 23342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:38379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:39777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:39777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:08:01.179718 23342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:08:01.179935 23342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:08:01.184257 23347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:01.184398 23342 server_base.cc:1034] running on GCE node
W20260620 22:08:01.184264 23350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:01.184271 23348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:01.184720 23342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:08:01.185003 23342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:08:01.186159 23342 hybrid_clock.cc:648] HybridClock initialized: now 1781993281186153 us; error 33 us; skew 500 ppm
Jun 20 22:08:01 dist-test-slave-xw35 krb5kdc[23329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993281, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:08:01.194679 23342 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:08:01.195082 23342 webserver.cc:460] Webserver started at http://127.1.55.254:41411/ using document root <none> and password file <none>
I20260620 22:08:01.195283 23342 fs_manager.cc:359] Metadata directory not provided
I20260620 22:08:01.195343 23342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:08:01.195489 23342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:08:01.196390 23342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "1ce5f25fa53b4950bbffe1a08b010666"
format_stamp: "Formatted at 2026-06-20 22:08:01 on dist-test-slave-xw35"
server_key: "d62cd6d1ae535a7746d09a6cb4a1b73e"
server_key_iv: "b778b874a51ab5554769238aed977dfe"
server_key_version: "encryptionkey@0"
I20260620 22:08:01.196713 23342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "1ce5f25fa53b4950bbffe1a08b010666"
format_stamp: "Formatted at 2026-06-20 22:08:01 on dist-test-slave-xw35"
server_key: "d62cd6d1ae535a7746d09a6cb4a1b73e"
server_key_iv: "b778b874a51ab5554769238aed977dfe"
server_key_version: "encryptionkey@0"
I20260620 22:08:01.197882 23342 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260620 22:08:01.198586 23357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:01.198877 23342 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260620 22:08:01.198974 23342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "1ce5f25fa53b4950bbffe1a08b010666"
format_stamp: "Formatted at 2026-06-20 22:08:01 on dist-test-slave-xw35"
server_key: "d62cd6d1ae535a7746d09a6cb4a1b73e"
server_key_iv: "b778b874a51ab5554769238aed977dfe"
server_key_version: "encryptionkey@0"
I20260620 22:08:01.199043 23342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:08:01.202114 23342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:08:01.203752 23342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:08:01.203896 23342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:08:01.207559 23342 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:39777
I20260620 22:08:01.207584 23409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:39777 every 8 connection(s)
I20260620 22:08:01.207911 23342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:08:01.208796 23410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:08:01.210769 23410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666: Bootstrap starting.
I20260620 22:08:01.211221 23410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666: Neither blocks nor log segments found. Creating new log.
I20260620 22:08:01.211436 23410 log.cc:824] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666: Log is configured to *not* fsync() on all Append() calls
I20260620 22:08:01.211971 23410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666: No bootstrap required, opened a new log
I20260620 22:08:01.213521 23410 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5f25fa53b4950bbffe1a08b010666" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39777 } }
I20260620 22:08:01.213661 23410 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 22:08:01.213680 23410 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ce5f25fa53b4950bbffe1a08b010666, State: Initialized, Role: FOLLOWER
I20260620 22:08:01.213765 23410 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5f25fa53b4950bbffe1a08b010666" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39777 } }
I20260620 22:08:01.213810 23410 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 22:08:01.213828 23410 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 22:08:01.213851 23410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:08:01.214550 23410 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5f25fa53b4950bbffe1a08b010666" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39777 } }
I20260620 22:08:01.214627 23410 leader_election.cc:302] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ce5f25fa53b4950bbffe1a08b010666; no voters:
I20260620 22:08:01.214744 23410 leader_election.cc:288] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260620 22:08:01.214802 23413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:08:01.214955 23413 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [term 1 LEADER]: Becoming Leader. State: Replica: 1ce5f25fa53b4950bbffe1a08b010666, State: Running, Role: LEADER
I20260620 22:08:01.215005 23410 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:08:01.215049 23413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5f25fa53b4950bbffe1a08b010666" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39777 } }
I20260620 22:08:01.215436 23414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ce5f25fa53b4950bbffe1a08b010666" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5f25fa53b4950bbffe1a08b010666" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39777 } } }
I20260620 22:08:01.215461 23415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ce5f25fa53b4950bbffe1a08b010666. Latest consensus state: current_term: 1 leader_uuid: "1ce5f25fa53b4950bbffe1a08b010666" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ce5f25fa53b4950bbffe1a08b010666" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 39777 } } }
I20260620 22:08:01.215528 23414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [sys.catalog]: This master's current role is: LEADER
I20260620 22:08:01.215535 23415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666 [sys.catalog]: This master's current role is: LEADER
I20260620 22:08:01.215713 23422 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:08:01.216002 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23342
I20260620 22:08:01.216109 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:08:01.216219 23422 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:08:01.216297 1247 external_mini_cluster.cc:1428] Setting key fc06fcfb8479705d6cfab0469e8b9d14
I20260620 22:08:01.218065 23422 catalog_manager.cc:1347] Generated new cluster ID: 7bbfa56b1b1546518d81f45b66aaee3e
I20260620 22:08:01.218122 23422 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:08:01.218353 23432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:01.216648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46367 (local address 127.1.55.254:39777)
0620 22:08:01.216861 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:01.216869 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:01.216927 (+ 58us) server_negotiation.cc:407] Connection header received
0620 22:08:01.217034 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:01.217042 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:01.217071 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:01.217218 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:01.217853 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:01.217856 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:01.217857 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:08:01.217860 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:01.217907 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:08:01.217936 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:01.218004 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:01.218135 (+ 131us) server_negotiation.cc:299] Negotiation successful
0620 22:08:01.218174 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":77,"threads_started":1}
I20260620 22:08:01.219126 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:08:01.222366 23432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:01.221550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41637 (local address 127.1.55.254:39777)
0620 22:08:01.221578 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:01.221579 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:01.221586 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:08:01.221603 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:01.221603 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:01.221607 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:01.221657 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:01.222186 (+ 529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:01.222187 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:01.222188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0620 22:08:01.222191 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:01.222202 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0620 22:08:01.222205 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:01.222255 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:01.222307 (+ 52us) server_negotiation.cc:299] Negotiation successful
0620 22:08:01.222318 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260620 22:08:01.225833 23422 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:08:01.225965 23422 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:08:01.233345 23422 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ce5f25fa53b4950bbffe1a08b010666: Generated new TSK 0
I20260620 22:08:01.233517 23422 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 22:08:01.237783 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23342
2026-06-20T22:08:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1237 ms)
[----------] 18 tests from AuthTokenIssuingTest (22662 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:08:01 dist-test-slave-xw35 krb5kdc[23441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:08:01 dist-test-slave-xw35 krb5kdc[23441](info): set up 2 sockets
Jun 20 22:08:01 dist-test-slave-xw35 krb5kdc[23441](info): commencing operation
krb5kdc: starting...
W20260620 22:08:02.229626 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.975s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:08:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:08:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:08:02.334174 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45543
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45543,127.1.55.253:33189,127.1.55.252:41291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:08:02.408921 23454 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 22:08:02.409102 23454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:08:02.409118 23454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:08:02.409138 23454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:08:02.410321 23454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:08:02.410360 23454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:08:02.410374 23454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:08:02.410409 23454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:08:02.410439 23454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:08:02.411830 23454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45543,127.1.55.253:33189,127.1.55.252:41291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:45543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:08:02.411998 23454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:08:02.412199 23454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:08:02.416599 23460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:02.416610 23459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:02.416620 23462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:02.416745 23454 server_base.cc:1034] running on GCE node
I20260620 22:08:02.417014 23454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:08:02.417307 23454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:08:02.418469 23454 hybrid_clock.cc:648] HybridClock initialized: now 1781993282418447 us; error 40 us; skew 500 ppm
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:08:02.420693 23454 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:08:02.421101 23454 webserver.cc:460] Webserver started at http://127.1.55.254:41245/ using document root <none> and password file <none>
I20260620 22:08:02.421326 23454 fs_manager.cc:359] Metadata directory not provided
I20260620 22:08:02.421389 23454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:08:02.421548 23454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:08:02.422446 23454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "5d4bb2fbae9548e7ac695d32755a3ebe"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "00983905f35ad7ac8ed28706634a02f7"
server_key_iv: "b395fa70c757f83e0bcd4ba774bd20ec"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.422777 23454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "5d4bb2fbae9548e7ac695d32755a3ebe"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "00983905f35ad7ac8ed28706634a02f7"
server_key_iv: "b395fa70c757f83e0bcd4ba774bd20ec"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.423954 23454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260620 22:08:02.424556 23469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:02.424715 23454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:08:02.424826 23454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "5d4bb2fbae9548e7ac695d32755a3ebe"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "00983905f35ad7ac8ed28706634a02f7"
server_key_iv: "b395fa70c757f83e0bcd4ba774bd20ec"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.424894 23454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:08:02.438098 23454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:08:02.439881 23454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:08:02.440048 23454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:08:02.443703 23454 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:45543
I20260620 22:08:02.443728 23521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:45543 every 8 connection(s)
I20260620 22:08:02.444010 23454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:08:02.444896 23522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:08:02.446305 23522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:02.447886 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23454
I20260620 22:08:02.447981 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:08:02.448159 1247 external_mini_cluster.cc:1428] Setting key 2ab2132fd970fd86a4f8ad2c496028dd
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.55.253@KRBTEST.COM; defaulting to no policy
I20260620 22:08:02.455843 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.446874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45543 (local address 127.0.0.1:40006)
0620 22:08:02.447003 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.447033 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.447401 (+ 368us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.447627 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.447629 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.448023 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.448241 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.448247 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.449235 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.449236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.449976 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.449978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.450465 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.450466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.450531 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.451004 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.451012 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.452632 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.454349 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.454364 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.454366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.454627 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.454874 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.454875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.454875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.454991 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.455400 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.455407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.455482 (+ 75us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.455585 (+ 103us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.455697 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":54,"threads_started":1}
I20260620 22:08:02.455845 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.447003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40006 (local address 127.1.55.254:45543)
0620 22:08:02.447119 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.447123 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.447147 (+ 24us) server_negotiation.cc:407] Connection header received
0620 22:08:02.447515 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.447516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.447531 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.447602 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.448354 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.449132 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.450074 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.450357 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.450472 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.452715 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.452722 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.452722 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.452728 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.454264 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.454710 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.454712 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.454712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.454793 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.455055 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.455074 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.455074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.455331 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.455392 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.455646 (+ 254us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.455778 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":81,"thread_start_us":57,"threads_started":1}
I20260620 22:08:02.456516 23522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:02.456790 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.456698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45902)
0620 22:08:02.456741 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.456776 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260620 22:08:02.456918 23473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
I20260620 22:08:02.457275 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.457199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45910)
0620 22:08:02.457239 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.457261 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260620 22:08:02.457407 23522 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:33189: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab.
Entry for principal kudu/127.1.55.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab.
I20260620 22:08:02.470480 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.253:33189
--webserver_interface=127.1.55.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab
--principal=kudu/127.1.55.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45543,127.1.55.253:33189,127.1.55.252:41291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:08:02.506628 23522 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } attempt: 1
I20260620 22:08:02.507035 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.506917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45926)
0620 22:08:02.506971 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.507008 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260620 22:08:02.507387 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.507302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45936)
0620 22:08:02.507341 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.507370 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260620 22:08:02.507503 23522 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:33189: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
W20260620 22:08:02.546527 23529 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 22:08:02.546695 23529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:08:02.546710 23529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:08:02.546727 23529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:08:02.547729 23529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:08:02.547780 23529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:08:02.547792 23529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:08:02.547803 23529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:08:02.547880 23529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:08:02.549309 23529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45543,127.1.55.253:33189,127.1.55.252:41291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab
--principal=kudu/127.1.55.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.253:33189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.55.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:08:02.549567 23529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:08:02.549790 23529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:08:02.553942 23534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:02.553967 23535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:02.554003 23529 server_base.cc:1034] running on GCE node
W20260620 22:08:02.554195 23537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:02.554419 23529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:08:02.554713 23529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:08:02.555846 23529 hybrid_clock.cc:648] HybridClock initialized: now 1781993282555836 us; error 25 us; skew 500 ppm
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:08:02.558023 23529 init.cc:377] Logged in from keytab as kudu/127.1.55.253@KRBTEST.COM (short username kudu)
I20260620 22:08:02.558401 23529 webserver.cc:460] Webserver started at http://127.1.55.253:46677/ using document root <none> and password file <none>
I20260620 22:08:02.558622 23529 fs_manager.cc:359] Metadata directory not provided
I20260620 22:08:02.558689 23529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:08:02.558837 23529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:08:02.559784 23529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/data/instance:
uuid: "40d0eadab10f49d4b782d3bcc39187bb"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "30601baf758bb7643234356192232a59"
server_key_iv: "5a534b29846faa3ab85410f70138cb2e"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.560111 23529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/wal/instance:
uuid: "40d0eadab10f49d4b782d3bcc39187bb"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "30601baf758bb7643234356192232a59"
server_key_iv: "5a534b29846faa3ab85410f70138cb2e"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.561285 23529 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:08:02.562009 23544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:02.562194 23529 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:02.562291 23529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/wal
uuid: "40d0eadab10f49d4b782d3bcc39187bb"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "30601baf758bb7643234356192232a59"
server_key_iv: "5a534b29846faa3ab85410f70138cb2e"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.562382 23529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:08:02.572547 23529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:08:02.574180 23529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:08:02.574321 23529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:08:02.575706 23522 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } attempt: 2
I20260620 22:08:02.576090 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.575950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45938)
0620 22:08:02.576013 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.576053 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260620 22:08:02.576436 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.576313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45950)
0620 22:08:02.576368 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.576401 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260620 22:08:02.576562 23522 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:33189: Network error: Client connection negotiation failed: client connection to 127.1.55.253:33189: connect: Connection refused (error 111)
I20260620 22:08:02.578171 23529 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.253:33189
I20260620 22:08:02.578195 23596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.253:33189 every 8 connection(s)
I20260620 22:08:02.578517 23529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
I20260620 22:08:02.579411 23597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:08:02.580744 23597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:02.584348 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23529
I20260620 22:08:02.584440 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-1/wal/instance
I20260620 22:08:02.584594 1247 external_mini_cluster.cc:1428] Setting key 1a4a31855fa19d4e181e1f4bb8090073
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:08:02.588833 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.581323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40008 (local address 127.1.55.254:45543)
0620 22:08:02.581376 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.581378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.581594 (+ 216us) server_negotiation.cc:407] Connection header received
0620 22:08:02.581991 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.581992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.582002 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.582053 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.582529 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.582951 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.583796 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.583965 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.584011 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.586177 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.586178 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.586179 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.586185 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.587506 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.587905 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.587906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.587906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.587966 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.588214 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.588215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.588215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.588317 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.588407 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.588672 (+ 265us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.588753 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260620 22:08:02.588985 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.581292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45543 (local address 127.0.0.1:40008)
0620 22:08:02.581438 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.581527 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.581919 (+ 392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.582108 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.582111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.582309 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.582468 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.582471 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.583048 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.583048 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.583732 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.583734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.584039 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.584040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.584136 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.584644 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.584652 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.586091 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.587597 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.587604 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.587606 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.587829 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.588040 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.588041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.588041 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.588142 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.588412 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.588418 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.588541 (+ 123us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.588637 (+ 96us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.588779 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260620 22:08:02.589426 23597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.55.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.252@KRBTEST.COM" created.
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:08:02.597188 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.589729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45958)
0620 22:08:02.589925 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.589937 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.589994 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.590119 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.590119 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.590276 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.590331 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.590333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.591091 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.591092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.591854 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.591856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.592237 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.592238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.592307 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.592681 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.592685 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.594477 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.596245 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.596246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.596246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.596392 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.596604 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.596605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.596605 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.596667 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.596922 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.596923 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.596956 (+ 33us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.597011 (+ 55us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.597092 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183}
I20260620 22:08:02.597255 23601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.589804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45958 (local address 127.1.55.253:33189)
0620 22:08:02.589928 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.589931 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.589986 (+ 55us) server_negotiation.cc:407] Connection header received
0620 22:08:02.590049 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.590050 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.590059 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.590113 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.590399 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.591007 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.591924 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.592176 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.592225 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.594565 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.594572 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.594572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.594577 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.596164 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.596473 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.596475 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.596475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.596522 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.596731 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.596732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.596732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.596852 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.596928 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.597034 (+ 106us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.597137 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":103,"thread_start_us":74,"threads_started":1}
I20260620 22:08:02.597963 23597 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:02.598272 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.598143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54192)
0620 22:08:02.598208 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.598244 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260620 22:08:02.598469 23547 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
I20260620 22:08:02.598831 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.598739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54200)
0620 22:08:02.598788 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.598810 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260620 22:08:02.598939 23597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:41291: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab.
Entry for principal kudu/127.1.55.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab.
I20260620 22:08:02.606419 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.252:41291
--webserver_interface=127.1.55.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab
--principal=kudu/127.1.55.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:33011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:45543,127.1.55.253:33189,127.1.55.252:41291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:08:02.648134 23597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } attempt: 1
I20260620 22:08:02.648589 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.648466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54208)
0620 22:08:02.648529 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.648565 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260620 22:08:02.648939 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.648865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54222)
0620 22:08:02.648902 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.648925 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260620 22:08:02.649044 23597 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:41291: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
I20260620 22:08:02.667693 23522 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } attempt: 3
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:08:02.674176 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.667999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45968)
0620 22:08:02.668050 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.668058 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.668116 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.668269 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.668270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.668434 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.668495 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.668497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.669146 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.669147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.669713 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.669715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.670101 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.670102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.670176 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.670616 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.670620 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.671659 (+ 1039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.673269 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.673270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.673270 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.673408 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.673662 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.673663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.673663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.673711 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.673971 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.673972 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.674006 (+ 34us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.674055 (+ 49us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.674119 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260620 22:08:02.674299 23601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.668045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45968 (local address 127.1.55.253:33189)
0620 22:08:02.668098 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.668100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.668110 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:08:02.668178 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.668179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.668190 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.668264 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.668578 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.669064 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.669810 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.670021 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.670101 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.671743 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.671751 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.671752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.671759 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.673190 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.673491 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.673492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.673492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.673582 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.673778 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.673779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.673779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.673907 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.673977 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.674130 (+ 153us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.674211 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:08:02.674618 23522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:02.674975 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.674867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54224)
0620 22:08:02.674917 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.674949 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260620 22:08:02.675295 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.675212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54236)
0620 22:08:02.675255 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.675278 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260620 22:08:02.675407 23522 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:41291: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
W20260620 22:08:02.682394 23604 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 22:08:02.682590 23604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:08:02.682606 23604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:08:02.682626 23604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:08:02.683642 23604 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:08:02.683676 23604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:08:02.683688 23604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:08:02.683701 23604 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:08:02.683712 23604 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:08:02.685078 23604 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:33011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:45543,127.1.55.253:33189,127.1.55.252:41291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab
--principal=kudu/127.1.55.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.252:41291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.55.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:08:02.685233 23604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:08:02.685376 23604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 22:08:02.689772 23604 server_base.cc:1034] running on GCE node
W20260620 22:08:02.689745 23609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:02.689741 23610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:02.689754 23612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:02.690150 23604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:08:02.690418 23604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:08:02.691569 23604 hybrid_clock.cc:648] HybridClock initialized: now 1781993282691559 us; error 27 us; skew 500 ppm
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:08:02.693751 23604 init.cc:377] Logged in from keytab as kudu/127.1.55.252@KRBTEST.COM (short username kudu)
I20260620 22:08:02.694192 23604 webserver.cc:460] Webserver started at http://127.1.55.252:33901/ using document root <none> and password file <none>
I20260620 22:08:02.694399 23604 fs_manager.cc:359] Metadata directory not provided
I20260620 22:08:02.694463 23604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:08:02.694608 23604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:08:02.695526 23604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/data/instance:
uuid: "f291c71dc94344169e0ba24fcbdbe36f"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "82953f7f57f2dfcf77892b96b0c1f0dc"
server_key_iv: "3c938cc4e240991465ce70c178a8c229"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.695881 23604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/wal/instance:
uuid: "f291c71dc94344169e0ba24fcbdbe36f"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "82953f7f57f2dfcf77892b96b0c1f0dc"
server_key_iv: "3c938cc4e240991465ce70c178a8c229"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.697117 23604 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:08:02.697806 23619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:02.697955 23604 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:02.698040 23604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/wal
uuid: "f291c71dc94344169e0ba24fcbdbe36f"
format_stamp: "Formatted at 2026-06-20 22:08:02 on dist-test-slave-xw35"
server_key: "82953f7f57f2dfcf77892b96b0c1f0dc"
server_key_iv: "3c938cc4e240991465ce70c178a8c229"
server_key_version: "encryptionkey@0"
I20260620 22:08:02.698110 23604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:08:02.706521 23522 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } attempt: 1
I20260620 22:08:02.706821 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.706723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54250)
0620 22:08:02.706770 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.706800 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260620 22:08:02.707127 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.707024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54262)
0620 22:08:02.707062 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.707083 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260620 22:08:02.707248 23522 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:41291: Network error: Client connection negotiation failed: client connection to 127.1.55.252:41291: connect: Connection refused (error 111)
I20260620 22:08:02.708357 23604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:08:02.710129 23604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:08:02.710254 23604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:08:02.713771 23604 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.252:41291
I20260620 22:08:02.713791 23671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.252:41291 every 8 connection(s)
I20260620 22:08:02.714103 23604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
I20260620 22:08:02.714934 23672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:08:02.716320 23672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:02.717193 23597 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } attempt: 2
I20260620 22:08:02.720297 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23604
I20260620 22:08:02.720382 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781993001979103-1247-0/minicluster-data/master-2/wal/instance
I20260620 22:08:02.720516 1247 external_mini_cluster.cc:1428] Setting key a8bf15557dd8f5e55da301bc9aebdaf6
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:08:02.725124 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.716917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40016 (local address 127.1.55.254:45543)
0620 22:08:02.716969 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.716970 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.717173 (+ 203us) server_negotiation.cc:407] Connection header received
0620 22:08:02.717751 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.717752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.717760 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.717811 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.718355 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.718832 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.719760 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.719954 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.720000 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.722208 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.722209 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.722210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.722216 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.723765 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.724122 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.724123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.724124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.724194 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.724503 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.724504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.724505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.724641 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.724715 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.724962 (+ 247us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.725030 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260620 22:08:02.725260 23674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.716901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:45543 (local address 127.0.0.1:40016)
0620 22:08:02.717055 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.717083 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.717665 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.717833 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.717835 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.718099 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.718276 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.718280 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.718907 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.718908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.719686 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.719688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.720034 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.720035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.720159 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.720614 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.720622 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.722124 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.723840 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.723845 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.723847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.724048 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.724260 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.724261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.724262 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.724414 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.724696 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.724714 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.724829 (+ 115us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.724919 (+ 90us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.725038 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":20,"thread_start_us":77,"threads_started":1}
I20260620 22:08:02.725646 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.717397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54272)
0620 22:08:02.717466 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.717493 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.717535 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.717858 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.717859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.717982 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.718021 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.718022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.719218 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.719219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.719707 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.719708 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.720180 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.720181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.720241 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.720979 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.720982 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.722517 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.724353 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.724354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.724354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.724559 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.724895 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.724896 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.724896 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.724959 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.725304 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.725304 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.725351 (+ 47us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.725417 (+ 66us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.725537 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260620 22:08:02.725819 23672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:02.726035 23675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.717516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54272 (local address 127.1.55.252:41291)
0620 22:08:02.717638 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.717641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.717672 (+ 31us) server_negotiation.cc:407] Connection header received
0620 22:08:02.717738 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.717739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.717758 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.717835 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.718093 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.719139 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.719799 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.720108 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.720168 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.722590 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.722596 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.722596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.722602 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.724282 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.724630 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.724633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.724633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.724686 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.725030 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.725031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.725031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.725203 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.725275 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.725841 (+ 566us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.725929 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":97,"thread_start_us":72,"threads_started":1}
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:08:02.728005 23597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb: Bootstrap starting.
I20260620 22:08:02.728966 23597 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb: Neither blocks nor log segments found. Creating new log.
I20260620 22:08:02.729290 23597 log.cc:824] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb: Log is configured to *not* fsync() on all Append() calls
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:08:02.730110 23597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb: No bootstrap required, opened a new log
I20260620 22:08:02.730489 23676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.720826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54276 (local address 127.1.55.252:41291)
0620 22:08:02.721144 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.721146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.721152 (+ 6us) server_negotiation.cc:407] Connection header received
0620 22:08:02.721170 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.721171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.721180 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.721236 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.721863 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.722362 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.723984 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.724304 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.724362 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.726917 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.726918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.726919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.726924 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.729222 (+ 2298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.729690 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.729691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.729692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.729744 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.729964 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.729965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.729966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.730087 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.730205 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.730303 (+ 98us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.730380 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":80,"threads_started":1}
I20260620 22:08:02.732385 23597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } }
I20260620 22:08:02.732532 23597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d0eadab10f49d4b782d3bcc39187bb, State: Initialized, Role: FOLLOWER
I20260620 22:08:02.732607 23597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } }
I20260620 22:08:02.732878 23674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.726032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:33189 (local address 127.0.0.1:45974)
0620 22:08:02.726060 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.726070 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.726103 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.726218 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.726218 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.726350 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.726395 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.726396 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.727097 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.727098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.727815 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.727818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.728425 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.728426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.728505 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.728843 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.728848 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.730251 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.731795 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.731796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.731796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.731996 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.732213 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.732214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.732214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.732271 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.732591 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.732592 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.732631 (+ 39us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.732708 (+ 77us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.732792 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15}
I20260620 22:08:02.732913 23679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.732991 23679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:02.733165 23597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:08:02.733167 23601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.726112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45974 (local address 127.1.55.253:33189)
0620 22:08:02.726144 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.726146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.726152 (+ 6us) server_negotiation.cc:407] Connection header received
0620 22:08:02.726167 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.726167 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.726174 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.726216 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.726461 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.727018 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.727908 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.728250 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.728347 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.730339 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.730340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.730340 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.730346 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.731717 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.732070 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.732071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.732071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.732146 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.732336 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.732337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.732337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.732494 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.732560 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.733033 (+ 473us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.733097 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:08:02.733542 23672 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } has no permanent_uuid. Determining permanent_uuid...
W20260620 22:08:02.734943 23690 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:08:02.735036 23690 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:08:02.735286 23529 master_runner.cc:186] Error getting master registration for 127.1.55.254:45543: OK, instance_id { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" instance_seqno: 1781993282442748 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 22:08:02.738330 23529 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 22:08:02.739786 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.731056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40028 (local address 127.1.55.254:45543)
0620 22:08:02.731229 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.731230 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.731238 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:08:02.731256 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.731256 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.731265 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.731324 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.731905 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.732521 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.733413 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.733685 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.733719 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.736624 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.736625 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.736626 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.736633 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.738706 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.739018 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.739019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.739019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.739070 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.739290 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.739290 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.739291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.739400 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.739534 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.739631 (+ 97us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.739695 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260620 22:08:02.740237 23674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.733748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54288)
0620 22:08:02.733840 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.733847 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.733885 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.734046 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.734047 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.734159 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.734179 (+ 20us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.734180 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.734977 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.734978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.735690 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.735693 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.736092 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.736093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.736153 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.736552 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.736556 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.737719 (+ 1163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.739387 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.739388 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.739388 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.739591 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.739763 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.739763 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.739764 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.739803 (+ 39us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.740022 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.740023 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.740050 (+ 27us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.740088 (+ 38us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.740157 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260620 22:08:02.740653 23676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.733818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54288 (local address 127.1.55.252:41291)
0620 22:08:02.733936 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.733938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.733942 (+ 4us) server_negotiation.cc:407] Connection header received
0620 22:08:02.733955 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.733956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.733980 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.734036 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.734276 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.734859 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.735773 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.736025 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.736280 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.737797 (+ 1517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.737798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.737798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.737803 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.739285 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.739668 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.739668 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.739669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.739708 (+ 39us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.739856 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.739857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.739857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.739957 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.740454 (+ 497us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.740490 (+ 36us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.740567 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260620 22:08:02.741585 23672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f: Bootstrap starting.
I20260620 22:08:02.742045 23672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f: Neither blocks nor log segments found. Creating new log.
I20260620 22:08:02.742293 23672 log.cc:824] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f: Log is configured to *not* fsync() on all Append() calls
I20260620 22:08:02.743044 23672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f: No bootstrap required, opened a new log
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:08:02.744799 23672 raft_consensus.cc:348] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } }
I20260620 22:08:02.744979 23672 raft_consensus.cc:729] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f291c71dc94344169e0ba24fcbdbe36f, State: Initialized, Role: FOLLOWER
I20260620 22:08:02.745086 23672 consensus_queue.cc:260] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } }
I20260620 22:08:02.745366 23672 sys_catalog.cc:564] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:08:02.745363 23693 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.746147 23693 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:02.747234 23601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.740328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45986 (local address 127.1.55.253:33189)
0620 22:08:02.740364 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.740366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.740442 (+ 76us) server_negotiation.cc:407] Connection header received
0620 22:08:02.740504 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.740504 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.740513 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.740571 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.741106 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.741532 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.742153 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.742436 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.742504 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.744503 (+ 1999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.744504 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.744505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.744511 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.745939 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.746272 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.746273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.746273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.746330 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.746519 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.746520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.746520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.746625 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.746737 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.747050 (+ 313us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.747126 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:08:02.748956 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:08:02.747182 23604 master_runner.cc:186] Error getting master registration for 127.1.55.254:45543: OK, instance_id { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" instance_seqno: 1781993282442748 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 22:08:02.749938 23604 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 22:08:02.750320 23704 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:08:02.750401 23704 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:08:02.750080 23496 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40028
I20260620 22:08:02.782409 23522 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } attempt: 2
Jun 20 22:08:02 dist-test-slave-xw35 krb5kdc[23441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993282, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:08:02.790395 23524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.782828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:41291 (local address 127.0.0.1:54292)
0620 22:08:02.782884 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:02.782895 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:02.782936 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:02.783105 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:02.783106 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:02.783293 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:02.783347 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.783349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.784216 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.784217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.784919 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:02.784921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.785350 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.785351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:02.785408 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.785904 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:02.785909 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:02.787341 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:02.789300 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.789301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.789302 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.789586 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.789785 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:02.789786 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:02.789786 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:02.789841 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:02.790092 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:02.790092 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:02.790132 (+ 40us) client_negotiation.cc:769] Sending connection context
0620 22:08:02.790194 (+ 62us) client_negotiation.cc:240] Negotiation successful
0620 22:08:02.790275 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260620 22:08:02.790405 23676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.782886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54292 (local address 127.1.55.252:41291)
0620 22:08:02.782938 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.782940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.782950 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:08:02.783012 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.783013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.783022 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.783077 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.783419 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.784137 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.784995 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.785276 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.785336 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.787431 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.787432 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.787432 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.787439 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.789182 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.789666 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.789667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.789667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.789726 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.789900 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.789901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.789901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.790019 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.790088 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.790228 (+ 140us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.790300 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260620 22:08:02.792318 23522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe: Bootstrap starting.
I20260620 22:08:02.793027 23522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe: Neither blocks nor log segments found. Creating new log.
I20260620 22:08:02.793313 23522 log.cc:824] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe: Log is configured to *not* fsync() on all Append() calls
I20260620 22:08:02.794227 23522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe: No bootstrap required, opened a new log
I20260620 22:08:02.795451 23522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } }
I20260620 22:08:02.795583 23522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d4bb2fbae9548e7ac695d32755a3ebe, State: Initialized, Role: FOLLOWER
I20260620 22:08:02.795656 23522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } }
I20260620 22:08:02.795954 23522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:08:02.796002 23496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 22:08:02.796068 23496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:08:02.796923 23496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } }
I20260620 22:08:02.797163 23496 leader_election.cc:288] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [CANDIDATE]: Term 1 election: Requested vote from peers 40d0eadab10f49d4b782d3bcc39187bb (127.1.55.253:33189), f291c71dc94344169e0ba24fcbdbe36f (127.1.55.252:41291)
I20260620 22:08:02.797724 23571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "40d0eadab10f49d4b782d3bcc39187bb"
I20260620 22:08:02.797874 23571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:08:02.798689 23571 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4bb2fbae9548e7ac695d32755a3ebe in term 1.
I20260620 22:08:02.799736 23473 leader_election.cc:302] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d0eadab10f49d4b782d3bcc39187bb, 5d4bb2fbae9548e7ac695d32755a3ebe; no voters:
I20260620 22:08:02.800279 23646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f291c71dc94344169e0ba24fcbdbe36f"
I20260620 22:08:02.800400 23646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:08:02.801219 23646 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d4bb2fbae9548e7ac695d32755a3ebe in term 1.
I20260620 22:08:02.802696 23454 master_runner.cc:263] No leader master found from master 5d4bb2fbae9548e7ac695d32755a3ebe
I20260620 22:08:02.802739 23454 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 22:08:02.795954 23707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.803267 23707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:02.803364 23707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:08:02.803444 23707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [term 1 LEADER]: Becoming Leader. State: Replica: 5d4bb2fbae9548e7ac695d32755a3ebe, State: Running, Role: LEADER
I20260620 22:08:02.803552 23707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } }
I20260620 22:08:02.803987 23707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d4bb2fbae9548e7ac695d32755a3ebe. Latest consensus state: current_term: 1 leader_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.804101 23707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: This master's current role is: LEADER
W20260620 22:08:02.804687 23718 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:08:02.804773 23718 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:08:02.806963 23727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:08:02.807112 23727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:08:02.809448 23601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.799760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46002 (local address 127.1.55.253:33189)
0620 22:08:02.799795 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.799796 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.800039 (+ 243us) server_negotiation.cc:407] Connection header received
0620 22:08:02.800147 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.800148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.800157 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.800197 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.800941 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.801644 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.802595 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.802888 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.802926 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.804438 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.804439 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.804440 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.804446 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.806096 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.807815 (+ 1719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.807816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.807816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.807876 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.808881 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.808882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.808882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.809014 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.809081 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.809289 (+ 208us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.809364 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:08:02.813511 23676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.802949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54300 (local address 127.1.55.252:41291)
0620 22:08:02.802982 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.802983 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.805990 (+ 3007us) server_negotiation.cc:407] Connection header received
0620 22:08:02.806012 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.806013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.806023 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.806099 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.806759 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.807340 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.808493 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.808781 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.808819 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.810423 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.810425 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.810425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.810431 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.812328 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.812712 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.812713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.812714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.812763 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.812952 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.812953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.812953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.813076 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.813139 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.813323 (+ 184us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.813401 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:08:02.814822 23525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:02.805735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40034 (local address 127.1.55.254:45543)
0620 22:08:02.805774 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.805776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.806061 (+ 285us) server_negotiation.cc:407] Connection header received
0620 22:08:02.806157 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.806158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.806167 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.806195 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.806783 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.807387 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.809776 (+ 2389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:02.810097 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:02.810137 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:02.811950 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:02.811951 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:02.811952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:02.811958 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:02.813581 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.814087 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.814088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.814088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.814142 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:02.814313 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:02.814315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:02.814315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:02.814448 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:02.814546 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:02.814675 (+ 129us) server_negotiation.cc:299] Negotiation successful
0620 22:08:02.814744 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260620 22:08:02.818214 23646 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [term 1 FOLLOWER]: Refusing update from remote peer 5d4bb2fbae9548e7ac695d32755a3ebe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:08:02.818279 23571 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [term 1 FOLLOWER]: Refusing update from remote peer 5d4bb2fbae9548e7ac695d32755a3ebe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:08:02.818559 23723 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:08:02.818727 23723 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:08:02.819854 23679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d4bb2fbae9548e7ac695d32755a3ebe. Latest consensus state: current_term: 1 leader_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.819937 23679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:02.820830 23693 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d4bb2fbae9548e7ac695d32755a3ebe. Latest consensus state: current_term: 1 leader_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.820910 23693 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:02.821976 23723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.822057 23723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: This master's current role is: LEADER
I20260620 22:08:02.822023 23693 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.822093 23693 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:02.822139 23730 mvcc.cc:205] Tried to move back new op lower bound from 7299044486421274624 to 7299044486364217344. Current Snapshot: MvccSnapshot[applied={T|T < 7299044486421274624}]
I20260620 22:08:02.822587 23733 mvcc.cc:205] Tried to move back new op lower bound from 7299044486421274624 to 7299044486364217344. Current Snapshot: MvccSnapshot[applied={T|T < 7299044486421274624}]
I20260620 22:08:02.823253 23707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.823333 23707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe [sys.catalog]: This master's current role is: LEADER
I20260620 22:08:02.823614 23679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d4bb2fbae9548e7ac695d32755a3ebe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 45543 } } peers { permanent_uuid: "40d0eadab10f49d4b782d3bcc39187bb" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 33189 } } peers { permanent_uuid: "f291c71dc94344169e0ba24fcbdbe36f" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 41291 } } }
I20260620 22:08:02.823693 23679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:02.824266 23731 mvcc.cc:205] Tried to move back new op lower bound from 7299044486421274624 to 7299044486364217344. Current Snapshot: MvccSnapshot[applied={T|T < 7299044486421274624}]
I20260620 22:08:02.825862 23727 catalog_manager.cc:1347] Generated new cluster ID: 187fa18e457a4d46806830698154c036
I20260620 22:08:02.825910 23727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:08:02.842613 23727 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:08:02.843232 23727 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:08:02.851138 23727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d4bb2fbae9548e7ac695d32755a3ebe: Generated new TSK 0
I20260620 22:08:02.851290 23727 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 22:08:02.876307 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.874872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46010 (local address 127.1.55.253:33189)
0620 22:08:02.874911 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.874913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.875739 (+ 826us) server_negotiation.cc:407] Connection header received
0620 22:08:02.875833 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.875834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.875844 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.875897 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.876249 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46010: BlockingRecv error: recv got EOF from 127.0.0.1:46010 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260620 22:08:02.876978 23676 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.875207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54306 (local address 127.1.55.252:41291)
0620 22:08:02.875242 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.875244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.876513 (+ 1269us) server_negotiation.cc:407] Connection header received
0620 22:08:02.876619 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.876620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.876629 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.876654 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.876928 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54306: BlockingRecv error: recv got EOF from 127.0.0.1:54306 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260620 22:08:02.877714 23525 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.875494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40046 (local address 127.1.55.254:45543)
0620 22:08:02.875541 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.875543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.877216 (+ 1673us) server_negotiation.cc:407] Connection header received
0620 22:08:02.877326 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.877327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.877337 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.877367 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.877661 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40046: BlockingRecv error: recv got EOF from 127.0.0.1:40046 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260620 22:08:02.879917 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.879228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46020 (local address 127.1.55.253:33189)
0620 22:08:02.879261 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.879262 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.879440 (+ 178us) server_negotiation.cc:407] Connection header received
0620 22:08:02.879536 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.879537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.879554 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.879582 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.879876 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46020: BlockingRecv error: recv got EOF from 127.0.0.1:46020 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 22:08:02.882740 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.882050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46022 (local address 127.1.55.253:33189)
0620 22:08:02.882082 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.882083 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.882302 (+ 219us) server_negotiation.cc:407] Connection header received
0620 22:08:02.882390 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.882391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.882399 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.882426 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.882701 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46022: BlockingRecv error: recv got EOF from 127.0.0.1:46022 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 22:08:02.886242 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.885640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46030 (local address 127.1.55.253:33189)
0620 22:08:02.885667 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.885668 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.885848 (+ 180us) server_negotiation.cc:407] Connection header received
0620 22:08:02.885937 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.885938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.885945 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.885968 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.886207 (+ 239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46030: BlockingRecv error: recv got EOF from 127.0.0.1:46030 (error 108)
Metrics: {"server-negotiator.queue_time_us":13}
W20260620 22:08:02.891834 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.891139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46038 (local address 127.1.55.253:33189)
0620 22:08:02.891169 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.891170 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.891378 (+ 208us) server_negotiation.cc:407] Connection header received
0620 22:08:02.891461 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.891462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.891470 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.891494 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.891748 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46038: BlockingRecv error: recv got EOF from 127.0.0.1:46038 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 22:08:02.901615 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.900881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46052 (local address 127.1.55.253:33189)
0620 22:08:02.900913 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.900915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.901122 (+ 207us) server_negotiation.cc:407] Connection header received
0620 22:08:02.901213 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.901214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.901223 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.901251 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.901571 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46052: BlockingRecv error: recv got EOF from 127.0.0.1:46052 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 22:08:02.919548 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.918887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46060 (local address 127.1.55.253:33189)
0620 22:08:02.918934 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.918936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.919046 (+ 110us) server_negotiation.cc:407] Connection header received
0620 22:08:02.919082 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.919083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.919093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.919164 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.919499 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46060: BlockingRecv error: recv got EOF from 127.0.0.1:46060 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260620 22:08:02.953024 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:02.952468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46068 (local address 127.1.55.253:33189)
0620 22:08:02.952529 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:02.952531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:02.952609 (+ 78us) server_negotiation.cc:407] Connection header received
0620 22:08:02.952638 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:02.952639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:02.952651 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:02.952716 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:02.952974 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46068: BlockingRecv error: recv got EOF from 127.0.0.1:46068 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260620 22:08:03.018682 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:03.017998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46070 (local address 127.1.55.253:33189)
0620 22:08:03.018058 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:03.018060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:03.018148 (+ 88us) server_negotiation.cc:407] Connection header received
0620 22:08:03.018190 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:03.018190 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:03.018199 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:03.018255 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:03.018599 (+ 344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46070: BlockingRecv error: recv got EOF from 127.0.0.1:46070 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260620 22:08:03.148420 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:03.147680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46084 (local address 127.1.55.253:33189)
0620 22:08:03.147763 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:03.147766 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:03.147927 (+ 161us) server_negotiation.cc:407] Connection header received
0620 22:08:03.147972 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:03.147973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:03.147984 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:03.148037 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:03.148360 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46084: BlockingRecv error: recv got EOF from 127.0.0.1:46084 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260620 22:08:03.406227 23601 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:03.405518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46094 (local address 127.1.55.253:33189)
0620 22:08:03.405592 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:03.405594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:03.405604 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:08:03.405711 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:03.405711 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:03.405729 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:03.405785 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:03.406163 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46094: BlockingRecv error: recv got EOF from 127.0.0.1:46094 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260620 22:08:03.735458 23690 catalog_manager.cc:1259] Loaded cluster ID: 187fa18e457a4d46806830698154c036
I20260620 22:08:03.735536 23690 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb: loading cluster ID for follower catalog manager: success
I20260620 22:08:03.736326 23690 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb: acquiring CA information for follower catalog manager: success
I20260620 22:08:03.736620 23690 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 40d0eadab10f49d4b782d3bcc39187bb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 22:08:03.750736 23704 catalog_manager.cc:1259] Loaded cluster ID: 187fa18e457a4d46806830698154c036
I20260620 22:08:03.750782 23704 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f: loading cluster ID for follower catalog manager: success
I20260620 22:08:03.751490 23704 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f: acquiring CA information for follower catalog manager: success
I20260620 22:08:03.751752 23704 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f291c71dc94344169e0ba24fcbdbe36f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 22:08:03.921977 23803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:03.919408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46096 (local address 127.1.55.253:33189)
0620 22:08:03.919525 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:03.919527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:03.919603 (+ 76us) server_negotiation.cc:407] Connection header received
0620 22:08:03.919713 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:03.919714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:03.919788 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:03.919881 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:03.920026 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.920486 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.921200 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.921396 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.921466 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:03.921660 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:03.921768 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:03.921856 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:03.921872 (+ 16us) server_negotiation.cc:299] Negotiation successful
0620 22:08:03.921890 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":52,"threads_started":1}
I20260620 22:08:03.925930 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:03.923567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54316 (local address 127.1.55.252:41291)
0620 22:08:03.923675 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:03.923677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:03.923685 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:08:03.923757 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:03.923758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:03.923815 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:03.923923 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:03.924011 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.924442 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.925107 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.925332 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.925405 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:03.925583 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:03.925684 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:03.925775 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:03.925831 (+ 56us) server_negotiation.cc:299] Negotiation successful
0620 22:08:03.925851 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":50,"threads_started":1}
I20260620 22:08:03.930159 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:03.927576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54322 (local address 127.1.55.252:41291)
0620 22:08:03.927609 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:03.927611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:03.927767 (+ 156us) server_negotiation.cc:407] Connection header received
0620 22:08:03.927864 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:03.927865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:03.927875 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:03.927931 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:03.928051 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.928758 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.929561 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.929761 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.929832 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:03.929985 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:03.930007 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:03.930045 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:03.930108 (+ 63us) server_negotiation.cc:299] Negotiation successful
0620 22:08:03.930122 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:08:03.930724 23803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:03.927490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46108 (local address 127.1.55.253:33189)
0620 22:08:03.927526 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:03.927527 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:03.927686 (+ 159us) server_negotiation.cc:407] Connection header received
0620 22:08:03.927849 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:03.927849 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:03.927868 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:03.927932 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:03.928172 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.928862 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.929909 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.930197 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.930250 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:03.930487 (+ 237us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:03.930518 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:03.930564 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:03.930627 (+ 63us) server_negotiation.cc:299] Negotiation successful
0620 22:08:03.930643 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260620 22:08:03.931329 23814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:03.927487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40058 (local address 127.1.55.254:45543)
0620 22:08:03.927717 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:03.927719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:03.927982 (+ 263us) server_negotiation.cc:407] Connection header received
0620 22:08:03.928029 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:03.928030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:03.928076 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:03.928150 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:03.928327 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.928939 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.930283 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:03.930585 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:03.930641 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:03.930996 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:03.931089 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:03.931175 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:03.931228 (+ 53us) server_negotiation.cc:299] Negotiation successful
0620 22:08:03.931249 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":45,"threads_started":1}
I20260620 22:08:03.932873 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23454
I20260620 22:08:03.938161 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23529
I20260620 22:08:03.943146 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23604
2026-06-20T22:08:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2707 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 20 22:08:03 dist-test-slave-xw35 krb5kdc[23820](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 20 22:08:03 dist-test-slave-xw35 krb5kdc[23820](info): set up 2 sockets
Jun 20 22:08:03 dist-test-slave-xw35 krb5kdc[23820](info): commencing operation
krb5kdc: starting...
W20260620 22:08:04.929740 1247 mini_kdc.cc:121] Time spent starting KDC: real 0.968s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/test-user.keytab.
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-20T22:08:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T22:08:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.55.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
Entry for principal kudu/127.1.55.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab.
I20260620 22:08:05.034204 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38599
--webserver_interface=127.1.55.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:32941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38599,127.1.55.253:39981,127.1.55.252:45895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260620 22:08:05.110406 23833 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 22:08:05.110642 23833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:08:05.110668 23833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:08:05.110706 23833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:08:05.111855 23833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:08:05.111917 23833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:08:05.111943 23833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:08:05.111970 23833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:08:05.111999 23833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:08:05.113421 23833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:32941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38599,127.1.55.253:39981,127.1.55.252:45895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.254.keytab
--principal=kudu/127.1.55.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.254:38599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.55.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:08:05.113685 23833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:08:05.113900 23833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:08:05.118011 23838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:05.118125 23839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:05.118230 23833 server_base.cc:1034] running on GCE node
W20260620 22:08:05.118026 23841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:05.118497 23833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:08:05.118758 23833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:08:05.119901 23833 hybrid_clock.cc:648] HybridClock initialized: now 1781993285119890 us; error 30 us; skew 500 ppm
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:08:05.122108 23833 init.cc:377] Logged in from keytab as kudu/127.1.55.254@KRBTEST.COM (short username kudu)
I20260620 22:08:05.122502 23833 webserver.cc:460] Webserver started at http://127.1.55.254:46579/ using document root <none> and password file <none>
I20260620 22:08:05.122714 23833 fs_manager.cc:359] Metadata directory not provided
I20260620 22:08:05.122756 23833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:08:05.122885 23833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:08:05.123834 23833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/data/instance:
uuid: "151890f8959f4df1bc83d143557267fe"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "5d9a1019953e3e66e262b517ee2d91b3"
server_key_iv: "0f3f71da3fabb12e937c752c4a17136f"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.124148 23833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/wal/instance:
uuid: "151890f8959f4df1bc83d143557267fe"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "5d9a1019953e3e66e262b517ee2d91b3"
server_key_iv: "0f3f71da3fabb12e937c752c4a17136f"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.125411 23833 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260620 22:08:05.126089 23848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:05.126261 23833 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:08:05.126350 23833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/wal
uuid: "151890f8959f4df1bc83d143557267fe"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "5d9a1019953e3e66e262b517ee2d91b3"
server_key_iv: "0f3f71da3fabb12e937c752c4a17136f"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.126432 23833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:08:05.156620 23833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:08:05.158298 23833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:08:05.158442 23833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:08:05.162118 23833 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.254:38599
I20260620 22:08:05.162153 23900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.254:38599 every 8 connection(s)
I20260620 22:08:05.162463 23833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/data/info.pb
I20260620 22:08:05.163367 23901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:08:05.164685 23901 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:05.167959 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23833
I20260620 22:08:05.168040 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-0/wal/instance
I20260620 22:08:05.168210 1247 external_mini_cluster.cc:1428] Setting key 77b03a33bf14144cc8489f3dc407bb99
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:08:05.174008 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.165393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59000 (local address 127.1.55.254:38599)
0620 22:08:05.165539 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.165543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.165592 (+ 49us) server_negotiation.cc:407] Connection header received
0620 22:08:05.166071 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.166073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.166088 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.166158 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.166625 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.167360 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.168263 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.168769 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.168877 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.171022 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.171028 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.171028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.171034 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.172531 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.172994 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.172996 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.172996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.173062 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.173293 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.173294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.173294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.173454 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.173599 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.173796 (+ 197us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.173878 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260620 22:08:05.174088 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.165258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38599 (local address 127.0.0.1:59000)
0620 22:08:05.165426 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.165458 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.165942 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.166190 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.166192 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.166408 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.166553 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.166557 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.167452 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.167452 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.168187 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.168189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.168870 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.168871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.168925 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.169418 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.169425 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.170939 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.172613 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.172621 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.172623 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.172897 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.173125 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.173126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.173126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.173231 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.173599 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.173605 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.173672 (+ 67us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.173773 (+ 101us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.173951 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":44,"thread_start_us":60,"threads_started":1}
I20260620 22:08:05.174763 23901 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:05.175091 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.174963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35424)
0620 22:08:05.175013 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.175060 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260620 22:08:05.175212 23849 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
I20260620 22:08:05.175632 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.175549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35436)
0620 22:08:05.175592 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.175616 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
WARNING: no policy specified for kudu/127.1.55.253@KRBTEST.COM; defaulting to no policy
W20260620 22:08:05.175747 23901 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:39981: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab.
Entry for principal kudu/127.1.55.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab.
I20260620 22:08:05.190269 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.253:39981
--webserver_interface=127.1.55.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab
--principal=kudu/127.1.55.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:32941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38599,127.1.55.253:39981,127.1.55.252:45895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:08:05.224982 23901 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } attempt: 1
I20260620 22:08:05.225382 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.225276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35444)
0620 22:08:05.225330 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.225360 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260620 22:08:05.225750 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.225664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35458)
0620 22:08:05.225699 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.225719 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260620 22:08:05.225916 23901 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:39981: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
W20260620 22:08:05.267127 23908 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 22:08:05.267289 23908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:08:05.267304 23908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:08:05.267345 23908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:08:05.268412 23908 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:08:05.268450 23908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:08:05.268462 23908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:08:05.268510 23908 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:08:05.268538 23908 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:08:05.270033 23908 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:32941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38599,127.1.55.253:39981,127.1.55.252:45895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.253.keytab
--principal=kudu/127.1.55.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.253:39981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.55.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:08:05.270247 23908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:08:05.270438 23908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:08:05.274571 23916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:05.274575 23914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:05.274655 23908 server_base.cc:1034] running on GCE node
W20260620 22:08:05.274608 23913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:05.274889 23908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:08:05.275161 23908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:08:05.276293 23908 hybrid_clock.cc:648] HybridClock initialized: now 1781993285276296 us; error 36 us; skew 500 ppm
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:08:05.278493 23908 init.cc:377] Logged in from keytab as kudu/127.1.55.253@KRBTEST.COM (short username kudu)
I20260620 22:08:05.278904 23908 webserver.cc:460] Webserver started at http://127.1.55.253:35623/ using document root <none> and password file <none>
I20260620 22:08:05.279126 23908 fs_manager.cc:359] Metadata directory not provided
I20260620 22:08:05.279192 23908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:08:05.279361 23908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:08:05.280285 23908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/data/instance:
uuid: "e1902d19e1424ac0bd0d5f0e10e2d694"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "aeed675d86e4d005f14db2cd24d6eead"
server_key_iv: "5e937ca474e5036d826cfe4e8ea6833d"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.280640 23908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/wal/instance:
uuid: "e1902d19e1424ac0bd0d5f0e10e2d694"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "aeed675d86e4d005f14db2cd24d6eead"
server_key_iv: "5e937ca474e5036d826cfe4e8ea6833d"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.281904 23908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260620 22:08:05.282519 23923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:05.282666 23908 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:08:05.282752 23908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/wal
uuid: "e1902d19e1424ac0bd0d5f0e10e2d694"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "aeed675d86e4d005f14db2cd24d6eead"
server_key_iv: "5e937ca474e5036d826cfe4e8ea6833d"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.282831 23908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:08:05.294049 23901 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } attempt: 2
I20260620 22:08:05.294373 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.294265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35468)
0620 22:08:05.294319 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.294348 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260620 22:08:05.294637 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.294567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35484)
0620 22:08:05.294600 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.294621 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260620 22:08:05.294713 23901 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.253:39981: Network error: Client connection negotiation failed: client connection to 127.1.55.253:39981: connect: Connection refused (error 111)
I20260620 22:08:05.298431 23908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:08:05.300050 23908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:08:05.300194 23908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:08:05.303773 23908 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.253:39981
I20260620 22:08:05.303865 23975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.253:39981 every 8 connection(s)
I20260620 22:08:05.304124 23908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/data/info.pb
I20260620 22:08:05.305008 23976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:08:05.306401 23976 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:08:05.313870 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.307004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59002 (local address 127.1.55.254:38599)
0620 22:08:05.307074 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.307076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.307235 (+ 159us) server_negotiation.cc:407] Connection header received
0620 22:08:05.307631 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.307632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.307643 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.307694 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.308215 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.308676 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.309639 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.309839 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.309890 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.311769 (+ 1879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.311771 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.311771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.311777 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.312818 (+ 1041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.313140 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.313141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.313141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.313186 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.313367 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.313367 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.313367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.313451 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.313555 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.313746 (+ 191us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.313818 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260620 22:08:05.314005 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.306964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38599 (local address 127.0.0.1:59002)
0620 22:08:05.307125 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.307156 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.307558 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.307738 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.307752 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.307979 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.308148 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.308152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.308750 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.308751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.309571 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.309574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.309914 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.309914 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.310009 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.310458 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.310466 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.311694 (+ 1228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.312893 (+ 1199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.312899 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.312900 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.313080 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.313237 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.313237 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.313237 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.313318 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.313551 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.313556 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.313647 (+ 91us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.313721 (+ 74us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.313814 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260620 22:08:05.314146 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23908
I20260620 22:08:05.314240 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-1/wal/instance
I20260620 22:08:05.314409 1247 external_mini_cluster.cc:1428] Setting key 84c74d77accefa2fdb6798e70efcc487
I20260620 22:08:05.314502 23976 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:08:05.321569 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.314742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35490)
0620 22:08:05.314815 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.314823 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.314858 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.315093 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.315094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.315234 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.315284 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.315285 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.316039 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.316040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.316827 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.316830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.317289 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.317290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.317351 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.317840 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.317844 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.318909 (+ 1065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.320542 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.320543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.320543 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.320688 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.320907 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.320908 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.320908 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.320958 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.321230 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.321231 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.321266 (+ 35us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.321329 (+ 63us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.321417 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260620 22:08:05.321630 23979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.314810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35490 (local address 127.1.55.253:39981)
0620 22:08:05.314973 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.314977 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.314992 (+ 15us) server_negotiation.cc:407] Connection header received
0620 22:08:05.315011 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.315013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.315029 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.315084 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.315392 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.315980 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.316903 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.317178 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.317288 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.319006 (+ 1718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.319013 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.319014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.319019 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.320452 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.320787 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.320790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.320790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.320841 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.321036 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.321037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.321037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.321155 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.321236 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.321375 (+ 139us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.321465 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":139,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.1.55.252@KRBTEST.COM; defaulting to no policy
I20260620 22:08:05.322106 23976 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:05.322378 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.322288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37628)
0620 22:08:05.322329 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.322362 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260620 22:08:05.322515 23924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
I20260620 22:08:05.322921 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.322837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37638)
0620 22:08:05.322885 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.322907 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260620 22:08:05.323067 23976 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:45895: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.55.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.55.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab.
Entry for principal kudu/127.1.55.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab.
I20260620 22:08:05.335875 1247 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskKulyh2/build/release/bin/kudu
/tmp/dist-test-taskKulyh2/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.252:45895
--webserver_interface=127.1.55.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab
--principal=kudu/127.1.55.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.55.212:32941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.55.254:38599,127.1.55.253:39981,127.1.55.252:45895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260620 22:08:05.372381 23976 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } attempt: 1
I20260620 22:08:05.372843 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.372706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37648)
0620 22:08:05.372787 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.372820 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260620 22:08:05.373226 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.373121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37656)
0620 22:08:05.373168 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.373199 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260620 22:08:05.373332 23976 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:45895: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
I20260620 22:08:05.385861 23901 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } attempt: 3
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:08:05.392493 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.386143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35500)
0620 22:08:05.386188 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.386198 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.386263 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.386414 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.386414 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.386579 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.386639 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.386641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.387280 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.387282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.387842 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.387844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.388230 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.388231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.388315 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.388820 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.388826 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.390028 (+ 1202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.391645 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.391646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.391646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.391802 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.391992 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.391993 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.391993 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.392040 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.392277 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.392278 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.392312 (+ 34us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.392375 (+ 63us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.392437 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260620 22:08:05.392563 23979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.386192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35500 (local address 127.1.55.253:39981)
0620 22:08:05.386237 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.386239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.386249 (+ 10us) server_negotiation.cc:407] Connection header received
0620 22:08:05.386326 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.386327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.386339 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.386409 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.386721 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.387197 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.387930 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.388153 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.388232 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.390112 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.390114 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.390114 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.390122 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.391557 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.391867 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.391868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.391869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.391927 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.392096 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.392096 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.392097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.392219 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.392282 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.392397 (+ 115us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.392467 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260620 22:08:05.392912 23901 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } has no permanent_uuid. Determining permanent_uuid...
I20260620 22:08:05.393214 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.393126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37658)
0620 22:08:05.393168 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.393192 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260620 22:08:05.393556 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.393453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37674)
0620 22:08:05.393515 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.393539 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260620 22:08:05.393657 23901 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:45895: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
W20260620 22:08:05.412209 23983 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260620 22:08:05.412385 23983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 22:08:05.412402 23983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 22:08:05.412422 23983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 22:08:05.413460 23983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 22:08:05.413545 23983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260620 22:08:05.413563 23983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 22:08:05.413575 23983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 22:08:05.413587 23983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 22:08:05.414952 23983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.55.212:32941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.55.254:38599,127.1.55.253:39981,127.1.55.252:45895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/krb5kdc/kudu_127.1.55.252.keytab
--principal=kudu/127.1.55.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.55.252:45895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.55.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 20 Jun 2026 20:55:05 UTC on ccycloud.quasar-ypstkz.root.comops.site
build id 4457724
I20260620 22:08:05.415115 23983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 22:08:05.415261 23983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 22:08:05.419407 23989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:05.419400 23991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 22:08:05.419405 23988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 22:08:05.419680 23983 server_base.cc:1034] running on GCE node
I20260620 22:08:05.419899 23983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 22:08:05.420147 23983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 22:08:05.421319 23983 hybrid_clock.cc:648] HybridClock initialized: now 1781993285421305 us; error 26 us; skew 500 ppm
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260620 22:08:05.423676 23983 init.cc:377] Logged in from keytab as kudu/127.1.55.252@KRBTEST.COM (short username kudu)
I20260620 22:08:05.424015 23983 webserver.cc:460] Webserver started at http://127.1.55.252:35105/ using document root <none> and password file <none>
I20260620 22:08:05.424187 23983 fs_manager.cc:359] Metadata directory not provided
I20260620 22:08:05.424221 23983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 22:08:05.424294 23983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 22:08:05.424815 23901 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } attempt: 1
I20260620 22:08:05.425120 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.425018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37690)
0620 22:08:05.425068 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.425098 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260620 22:08:05.425406 23983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/data/instance:
uuid: "e909ddb7610a468fa11ee7c03a0f6931"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "40d9062ba888f4e26c92731a32ec1313"
server_key_iv: "d44edb6d7e785ad51d60c385c5c23a37"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.425565 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.425446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37700)
0620 22:08:05.425517 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.425548 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260620 22:08:05.425679 23901 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:45895: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
I20260620 22:08:05.425843 23983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/wal/instance:
uuid: "e909ddb7610a468fa11ee7c03a0f6931"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "40d9062ba888f4e26c92731a32ec1313"
server_key_iv: "d44edb6d7e785ad51d60c385c5c23a37"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.427073 23983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260620 22:08:05.427750 23998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 22:08:05.427964 23983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260620 22:08:05.428057 23983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/data,/tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/wal
uuid: "e909ddb7610a468fa11ee7c03a0f6931"
format_stamp: "Formatted at 2026-06-20 22:08:05 on dist-test-slave-xw35"
server_key: "40d9062ba888f4e26c92731a32ec1313"
server_key_iv: "d44edb6d7e785ad51d60c385c5c23a37"
server_key_version: "encryptionkey@0"
I20260620 22:08:05.428141 23983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 22:08:05.441458 23976 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } attempt: 2
I20260620 22:08:05.441866 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.441721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37716)
0620 22:08:05.441797 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.441832 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260620 22:08:05.442241 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.442142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37732)
0620 22:08:05.442190 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.442218 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260620 22:08:05.442365 23976 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.55.252:45895: Network error: Client connection negotiation failed: client connection to 127.1.55.252:45895: connect: Connection refused (error 111)
I20260620 22:08:05.443079 23983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 22:08:05.444689 23983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 22:08:05.444818 23983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 22:08:05.448549 23983 rpc_server.cc:307] RPC server started. Bound to: 127.1.55.252:45895
I20260620 22:08:05.448575 24050 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.55.252:45895 every 8 connection(s)
I20260620 22:08:05.448909 23983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/data/info.pb
I20260620 22:08:05.449604 1247 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskKulyh2/build/release/bin/kudu as pid 23983
I20260620 22:08:05.449723 1247 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskKulyh2/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781993001979103-1247-0/minicluster-data/master-2/wal/instance
I20260620 22:08:05.449950 1247 external_mini_cluster.cc:1428] Setting key 6af32c0182a2dec846b8593018c63939
I20260620 22:08:05.449990 24051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 22:08:05.452167 24051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:08:05.459721 24054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.450427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37744 (local address 127.1.55.252:45895)
0620 22:08:05.450576 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.450582 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.450603 (+ 21us) server_negotiation.cc:407] Connection header received
0620 22:08:05.450932 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.450938 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.450975 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.451070 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.451871 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.452797 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.453858 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.454202 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.454333 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.456418 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.456425 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.456425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.456430 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.458225 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.458537 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.458540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.458540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.458670 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.458878 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.458878 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.458879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.459154 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.459292 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.459388 (+ 96us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.459537 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":67,"threads_started":1}
I20260620 22:08:05.459797 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.452756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59014 (local address 127.1.55.254:38599)
0620 22:08:05.452832 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.452834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.453012 (+ 178us) server_negotiation.cc:407] Connection header received
0620 22:08:05.453094 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.453094 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.453102 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.453148 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.453628 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.454029 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.454935 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.455118 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.455182 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.457094 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.457095 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.457096 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.457103 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.458520 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.458983 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.458985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.458985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.459037 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.459218 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.459219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.459219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.459348 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.459413 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.459628 (+ 215us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.459696 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260620 22:08:05.459854 24055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.452729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.254:38599 (local address 127.0.0.1:59014)
0620 22:08:05.452902 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.452940 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.453022 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.453197 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.453200 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.453479 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.453561 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.453562 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.454111 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.454112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.454831 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.454834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.455219 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.455220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.455286 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.455681 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.455688 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.457014 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.458594 (+ 1580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.458599 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.458601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.458907 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.459102 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.459102 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.459102 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.459152 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.459421 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.459427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.459476 (+ 49us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.459582 (+ 106us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.459688 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":99,"threads_started":1}
I20260620 22:08:05.460319 24051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.254@KRBTEST.COM
I20260620 22:08:05.466406 24055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.460515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.253:39981 (local address 127.0.0.1:35514)
0620 22:08:05.460550 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.460559 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.460589 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.460679 (+ 90us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.460680 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.460772 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.460810 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.460811 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.461599 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.461600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.462130 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.462131 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.462527 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.462528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.462578 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.462947 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.462951 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.463877 (+ 926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.465423 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.465424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.465424 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.465629 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.465822 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.465822 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.465822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.465866 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.466112 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.466113 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.466154 (+ 41us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.466234 (+ 80us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.466332 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260620 22:08:05.466441 23979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.460555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35514 (local address 127.1.55.253:39981)
0620 22:08:05.460596 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.460598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.460606 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:08:05.460627 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.460628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.460635 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.460686 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.460883 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.461524 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.462207 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.462471 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.462514 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.463950 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.463951 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.463951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.463956 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.465332 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.465700 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.465701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.465701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.465757 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.465924 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.465925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.465925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.466050 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.466107 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.466249 (+ 142us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.466323 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260620 22:08:05.467168 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.460471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59026 (local address 127.1.55.254:38599)
0620 22:08:05.460508 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.460509 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.460517 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:08:05.460535 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.460535 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.460542 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.460591 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.461211 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.461728 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.462406 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.462603 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.462676 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.464621 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.464622 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.464622 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.464627 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.465988 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.466340 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.466340 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.466341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.466401 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.466622 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.466623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.466623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.466723 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.466829 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.467047 (+ 218us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.467097 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:08:05.467162 24051 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } has no permanent_uuid. Determining permanent_uuid...
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.252@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.55.253@KRBTEST.COM
I20260620 22:08:05.474017 24055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.467378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37756)
0620 22:08:05.467412 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.467422 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.467461 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.467601 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.467602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.467778 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.467827 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.467829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.468781 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.468782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.469283 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.469285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.469740 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.469741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.469801 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.470336 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.470341 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.471470 (+ 1129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.472941 (+ 1471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.472942 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.472942 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.473098 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.473304 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.473305 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.473305 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.473357 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.473642 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.473643 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.473679 (+ 36us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.473779 (+ 100us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.473871 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260620 22:08:05.474077 24054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.467449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37756 (local address 127.1.55.252:45895)
0620 22:08:05.467512 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.467514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.467521 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:08:05.467538 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.467539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.467548 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.467599 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.467906 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.468650 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.469381 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.469660 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.469739 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.471560 (+ 1821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.471561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.471562 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.471567 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.472861 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.473184 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.473184 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.473185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.473233 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.473437 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.473437 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.473438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.473577 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.473648 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.473812 (+ 164us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.473920 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":46}
I20260620 22:08:05.474838 23979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.467696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35528 (local address 127.1.55.253:39981)
0620 22:08:05.467727 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.467729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.467763 (+ 34us) server_negotiation.cc:407] Connection header received
0620 22:08:05.467863 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.467864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.467870 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.467911 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.468428 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.468833 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.469450 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.469676 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.469759 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.472298 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.472299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.472299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.472306 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.473681 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.474079 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.474080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.474080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.474131 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.474361 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.474362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.474363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.474485 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.474623 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.474679 (+ 56us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.474748 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260620 22:08:05.475734 24051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931: Bootstrap starting.
I20260620 22:08:05.476022 1247 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260620 22:08:05.476495 24051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931: Neither blocks nor log segments found. Creating new log.
I20260620 22:08:05.476789 24051 log.cc:824] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931: Log is configured to *not* fsync() on all Append() calls
I20260620 22:08:05.477445 24051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931: No bootstrap required, opened a new log
I20260620 22:08:05.476943 23875 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "151890f8959f4df1bc83d143557267fe"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59026
I20260620 22:08:05.478816 24051 raft_consensus.cc:348] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } }
I20260620 22:08:05.478926 24051 raft_consensus.cc:729] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e909ddb7610a468fa11ee7c03a0f6931, State: Initialized, Role: FOLLOWER
I20260620 22:08:05.479012 24051 consensus_queue.cc:260] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } }
I20260620 22:08:05.479324 24051 sys_catalog.cc:564] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:08:05.479323 24057 sys_catalog.cc:455] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.479449 24057 sys_catalog.cc:458] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [sys.catalog]: This master's current role is: FOLLOWER
W20260620 22:08:05.481094 24068 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:08:05.481168 24068 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:08:05.481333 23983 master_runner.cc:186] Error getting master registration for 127.1.55.254:38599: OK, instance_id { permanent_uuid: "151890f8959f4df1bc83d143557267fe" instance_seqno: 1781993285161047 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 22:08:05.483309 23983 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 22:08:05.500828 23901 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } attempt: 2
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.254@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:08:05.507387 24054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.501143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37770 (local address 127.1.55.252:45895)
0620 22:08:05.501196 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.501198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.501205 (+ 7us) server_negotiation.cc:407] Connection header received
0620 22:08:05.501229 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.501230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.501238 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.501291 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.501616 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.502007 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.502672 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.502901 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.502961 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.504923 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.504925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.504925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.504931 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.506299 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.506637 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.506638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.506639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.506690 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.506877 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.506878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.506878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.507011 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.507068 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.507237 (+ 169us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.507303 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260620 22:08:05.507424 23903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.501069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37770)
0620 22:08:05.501130 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.501141 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.501183 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.501307 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.501308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.501449 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.501528 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.501531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.502078 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.502079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.502590 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.502592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.502996 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.502997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.503061 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.503430 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.503435 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.504832 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.506352 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.506353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.506354 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.506561 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.506753 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.506754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.506754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.506812 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.507077 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.507078 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.507136 (+ 58us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.507206 (+ 70us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.507299 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260620 22:08:05.508769 23901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe: Bootstrap starting.
I20260620 22:08:05.509336 23901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe: Neither blocks nor log segments found. Creating new log.
I20260620 22:08:05.509660 23901 log.cc:824] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe: Log is configured to *not* fsync() on all Append() calls
I20260620 22:08:05.510339 23901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe: No bootstrap required, opened a new log
I20260620 22:08:05.511274 23901 raft_consensus.cc:348] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } }
I20260620 22:08:05.511392 23901 raft_consensus.cc:729] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 151890f8959f4df1bc83d143557267fe, State: Initialized, Role: FOLLOWER
I20260620 22:08:05.511480 23901 consensus_queue.cc:260] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } }
I20260620 22:08:05.511770 23901 sys_catalog.cc:564] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:08:05.511744 24071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.511830 24071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:05.511885 23875 raft_consensus.cc:482] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260620 22:08:05.512027 23875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:08:05.512845 23875 raft_consensus.cc:504] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } }
I20260620 22:08:05.513093 23875 leader_election.cc:288] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [CANDIDATE]: Term 1 election: Requested vote from peers e1902d19e1424ac0bd0d5f0e10e2d694 (127.1.55.253:39981), e909ddb7610a468fa11ee7c03a0f6931 (127.1.55.252:45895)
I20260620 22:08:05.513185 24082 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260620 22:08:05.513634 24025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "151890f8959f4df1bc83d143557267fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e909ddb7610a468fa11ee7c03a0f6931"
I20260620 22:08:05.513772 24025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:08:05.514835 24025 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 151890f8959f4df1bc83d143557267fe in term 1.
I20260620 22:08:05.515048 23849 leader_election.cc:302] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 151890f8959f4df1bc83d143557267fe, e909ddb7610a468fa11ee7c03a0f6931; no voters:
I20260620 22:08:05.515372 24071 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [term 1 FOLLOWER]: Leader election won for term 1
I20260620 22:08:05.515537 24071 raft_consensus.cc:686] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [term 1 LEADER]: Becoming Leader. State: Replica: 151890f8959f4df1bc83d143557267fe, State: Running, Role: LEADER
I20260620 22:08:05.515625 24071 consensus_queue.cc:237] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } }
I20260620 22:08:05.516014 24071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 151890f8959f4df1bc83d143557267fe. Latest consensus state: current_term: 1 leader_uuid: "151890f8959f4df1bc83d143557267fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.516083 24071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: This master's current role is: LEADER
I20260620 22:08:05.516927 23833 master_runner.cc:186] Error getting master registration for 127.1.55.253:39981: OK, instance_id { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" instance_seqno: 1781993285302788 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 22:08:05.519721 23833 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 22:08:05.522365 23979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.514445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35540 (local address 127.1.55.253:39981)
0620 22:08:05.514480 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.514482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.514657 (+ 175us) server_negotiation.cc:407] Connection header received
0620 22:08:05.514747 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.514748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.514758 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.514787 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.515815 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.516534 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.517819 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.518111 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.518184 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.519615 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.519616 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.519616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.519623 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.521101 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.521521 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.521523 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.521523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.521573 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.521791 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.521792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.521792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.521931 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.522005 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.522220 (+ 215us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.522293 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260620 22:08:05.527496 24092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 22:08:05.528026 24092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 22:08:05.529165 23904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.514156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59038 (local address 127.1.55.254:38599)
0620 22:08:05.514199 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.514201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.521591 (+ 7390us) server_negotiation.cc:407] Connection header received
0620 22:08:05.521651 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.521652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.521662 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.521710 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.522265 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.522952 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.524338 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.524671 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.524706 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.526131 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.526132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.526132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.526139 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.527971 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.528359 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.528360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.528361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.528415 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.528621 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.528622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.528622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.528746 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.528812 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.529008 (+ 196us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.529077 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260620 22:08:05.529738 24054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.514509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37784 (local address 127.1.55.252:45895)
0620 22:08:05.514552 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.514554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.522655 (+ 8101us) server_negotiation.cc:407] Connection header received
0620 22:08:05.522720 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.522721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.522730 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.522799 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.523329 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.523976 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.525026 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.525311 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.525350 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.526699 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.526701 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.526701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.526707 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.528255 (+ 1548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.528603 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.528604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.528604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.528659 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.528861 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.528862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.528862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.528984 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.529065 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.529575 (+ 510us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.529645 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:08:05.533545 23976 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } attempt: 3
I20260620 22:08:05.535131 24025 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [term 1 FOLLOWER]: Refusing update from remote peer 151890f8959f4df1bc83d143557267fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:08:05.535599 24071 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:08:05.536763 24057 sys_catalog.cc:455] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 151890f8959f4df1bc83d143557267fe. Latest consensus state: current_term: 1 leader_uuid: "151890f8959f4df1bc83d143557267fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.536852 24057 sys_catalog.cc:458] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:05.538045 24071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "151890f8959f4df1bc83d143557267fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.538121 24071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: This master's current role is: LEADER
I20260620 22:08:05.538458 24057 sys_catalog.cc:455] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "151890f8959f4df1bc83d143557267fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.538527 24057 sys_catalog.cc:458] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:05.538789 24094 mvcc.cc:205] Tried to move back new op lower bound from 7299044497549123584 to 7299044497472659456. Current Snapshot: MvccSnapshot[applied={T|T < 7299044497549123584}]
I20260620 22:08:05.539501 24095 mvcc.cc:205] Tried to move back new op lower bound from 7299044497549123584 to 7299044497472659456. Current Snapshot: MvccSnapshot[applied={T|T < 7299044497549123584}]
Jun 20 22:08:05 dist-test-slave-xw35 krb5kdc[23820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781993285, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.55.253@KRBTEST.COM for kudu/127.1.55.252@KRBTEST.COM
I20260620 22:08:05.547210 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.533767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.55.252:45895 (local address 127.0.0.1:37794)
0620 22:08:05.534065 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0620 22:08:05.534074 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0620 22:08:05.534120 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 22:08:05.534349 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0620 22:08:05.534350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0620 22:08:05.534513 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0620 22:08:05.534550 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.534551 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.535645 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.535646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.536364 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0620 22:08:05.536365 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.537106 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.537107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0620 22:08:05.537170 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.537819 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0620 22:08:05.537824 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0620 22:08:05.543361 (+ 5537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0620 22:08:05.545975 (+ 2614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.545977 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.545977 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.546161 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.546449 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0620 22:08:05.546450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0620 22:08:05.546450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0620 22:08:05.546513 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0620 22:08:05.546940 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0620 22:08:05.546941 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0620 22:08:05.546983 (+ 42us) client_negotiation.cc:769] Sending connection context
0620 22:08:05.547029 (+ 46us) client_negotiation.cc:240] Negotiation successful
0620 22:08:05.547115 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284}
I20260620 22:08:05.547957 24054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:05.533822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37794 (local address 127.1.55.252:45895)
0620 22:08:05.533867 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.533868 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.534120 (+ 252us) server_negotiation.cc:407] Connection header received
0620 22:08:05.534206 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.534207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.534215 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.534626 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.534666 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.535530 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.536530 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:05.537000 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:05.537332 (+ 332us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:05.543462 (+ 6130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0620 22:08:05.543463 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0620 22:08:05.543463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0620 22:08:05.543469 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0620 22:08:05.545859 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.546284 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.546285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.546286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.546359 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0620 22:08:05.546587 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0620 22:08:05.546588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0620 22:08:05.546588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0620 22:08:05.546804 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0620 22:08:05.547571 (+ 767us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:05.547644 (+ 73us) server_negotiation.cc:299] Negotiation successful
0620 22:08:05.547791 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260620 22:08:05.549670 23976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694: Bootstrap starting.
I20260620 22:08:05.549871 24092 catalog_manager.cc:1347] Generated new cluster ID: c13c9df3e127414d9f0f18fdd98ca31d
I20260620 22:08:05.549913 24092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 22:08:05.550351 23976 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694: Neither blocks nor log segments found. Creating new log.
I20260620 22:08:05.550627 23976 log.cc:824] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694: Log is configured to *not* fsync() on all Append() calls
I20260620 22:08:05.558821 24092 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 22:08:05.560103 24092 catalog_manager.cc:1504] Loading token signing keys...
I20260620 22:08:05.561915 23976 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694: No bootstrap required, opened a new log
I20260620 22:08:05.563899 23976 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } }
I20260620 22:08:05.564028 23976 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1902d19e1424ac0bd0d5f0e10e2d694, State: Initialized, Role: FOLLOWER
I20260620 22:08:05.564095 23976 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } }
I20260620 22:08:05.564405 23976 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 22:08:05.564512 23949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [term 0 FOLLOWER]: Advancing to term 1
I20260620 22:08:05.565351 23949 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [term 1 FOLLOWER]: Refusing update from remote peer 151890f8959f4df1bc83d143557267fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 22:08:05.565760 24090 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 22:08:05.566004 23950 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "151890f8959f4df1bc83d143557267fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694"
W20260620 22:08:05.566061 24111 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 22:08:05.566104 24111 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 22:08:05.567226 23950 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 151890f8959f4df1bc83d143557267fe in term 1.
I20260620 22:08:05.569545 24100 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "151890f8959f4df1bc83d143557267fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.569630 24100 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:05.569676 24100 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 151890f8959f4df1bc83d143557267fe. Latest consensus state: current_term: 1 leader_uuid: "151890f8959f4df1bc83d143557267fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.569720 24100 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:05.569746 24100 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "151890f8959f4df1bc83d143557267fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.569801 24100 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 22:08:05.574568 24114 mvcc.cc:205] Tried to move back new op lower bound from 7299044497644707840 to 7299044497472659456. Current Snapshot: MvccSnapshot[applied={T|T < 7299044497549123584}]
I20260620 22:08:05.582780 24090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "151890f8959f4df1bc83d143557267fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151890f8959f4df1bc83d143557267fe" member_type: VOTER last_known_addr { host: "127.1.55.254" port: 38599 } } peers { permanent_uuid: "e1902d19e1424ac0bd0d5f0e10e2d694" member_type: VOTER last_known_addr { host: "127.1.55.253" port: 39981 } } peers { permanent_uuid: "e909ddb7610a468fa11ee7c03a0f6931" member_type: VOTER last_known_addr { host: "127.1.55.252" port: 45895 } } }
I20260620 22:08:05.582864 24090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe [sys.catalog]: This master's current role is: LEADER
I20260620 22:08:05.585011 24092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 151890f8959f4df1bc83d143557267fe: Generated new TSK 0
I20260620 22:08:05.585212 24092 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260620 22:08:05.611712 23904 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.610256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59044 (local address 127.1.55.254:38599)
0620 22:08:05.610307 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.610310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.611128 (+ 818us) server_negotiation.cc:407] Connection header received
0620 22:08:05.611218 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.611219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.611228 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.611255 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.611655 (+ 400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59044: BlockingRecv error: recv got EOF from 127.0.0.1:59044 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260620 22:08:05.612411 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.610652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35550 (local address 127.1.55.253:39981)
0620 22:08:05.610687 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.610689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.611928 (+ 1239us) server_negotiation.cc:407] Connection header received
0620 22:08:05.612012 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.612013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.612021 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.612047 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.612355 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35550: BlockingRecv error: recv got EOF from 127.0.0.1:35550 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260620 22:08:05.613058 24054 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.610908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37800 (local address 127.1.55.252:45895)
0620 22:08:05.610941 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.610943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.612607 (+ 1664us) server_negotiation.cc:407] Connection header received
0620 22:08:05.612695 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.612696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.612705 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.612733 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.613005 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37800: BlockingRecv error: recv got EOF from 127.0.0.1:37800 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260620 22:08:05.615131 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.614457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35552 (local address 127.1.55.253:39981)
0620 22:08:05.614486 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.614488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.614684 (+ 196us) server_negotiation.cc:407] Connection header received
0620 22:08:05.614775 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.614776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.614789 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.614816 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.615084 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35552: BlockingRecv error: recv got EOF from 127.0.0.1:35552 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260620 22:08:05.617867 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.617182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35564 (local address 127.1.55.253:39981)
0620 22:08:05.617212 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.617213 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.617414 (+ 201us) server_negotiation.cc:407] Connection header received
0620 22:08:05.617524 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.617525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.617534 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.617560 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.617834 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35564: BlockingRecv error: recv got EOF from 127.0.0.1:35564 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 22:08:05.621624 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.620866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35568 (local address 127.1.55.253:39981)
0620 22:08:05.620896 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.620897 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.621077 (+ 180us) server_negotiation.cc:407] Connection header received
0620 22:08:05.621159 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.621160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.621168 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.621193 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.621574 (+ 381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35568: BlockingRecv error: recv got EOF from 127.0.0.1:35568 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 22:08:05.627305 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.626633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35576 (local address 127.1.55.253:39981)
0620 22:08:05.626664 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.626665 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.626848 (+ 183us) server_negotiation.cc:407] Connection header received
0620 22:08:05.626945 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.626946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.626954 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.626980 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.627257 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35576: BlockingRecv error: recv got EOF from 127.0.0.1:35576 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 22:08:05.637084 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.636378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35584 (local address 127.1.55.253:39981)
0620 22:08:05.636410 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.636411 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.636626 (+ 215us) server_negotiation.cc:407] Connection header received
0620 22:08:05.636714 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.636714 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.636724 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.636763 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.637045 (+ 282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35584: BlockingRecv error: recv got EOF from 127.0.0.1:35584 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260620 22:08:05.655190 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.654310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35592 (local address 127.1.55.253:39981)
0620 22:08:05.654348 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.654350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.654616 (+ 266us) server_negotiation.cc:407] Connection header received
0620 22:08:05.654721 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.654722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.654733 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.654762 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.655140 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35592: BlockingRecv error: recv got EOF from 127.0.0.1:35592 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260620 22:08:05.689224 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.688542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.1.55.253:39981)
0620 22:08:05.688595 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.688602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.688697 (+ 95us) server_negotiation.cc:407] Connection header received
0620 22:08:05.688766 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.688767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.688781 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.688845 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.689165 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35594: BlockingRecv error: recv got EOF from 127.0.0.1:35594 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260620 22:08:05.754871 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.754248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35598 (local address 127.1.55.253:39981)
0620 22:08:05.754335 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.754337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.754400 (+ 63us) server_negotiation.cc:407] Connection header received
0620 22:08:05.754447 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.754447 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.754457 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.754503 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.754816 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35598: BlockingRecv error: recv got EOF from 127.0.0.1:35598 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260620 22:08:05.884868 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:05.884004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35608 (local address 127.1.55.253:39981)
0620 22:08:05.884099 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:05.884101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:05.884211 (+ 110us) server_negotiation.cc:407] Connection header received
0620 22:08:05.884310 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:05.884311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:05.884324 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:05.884401 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:05.884778 (+ 377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35608: BlockingRecv error: recv got EOF from 127.0.0.1:35608 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260620 22:08:06.142577 23979 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 22:08:06.141977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35614 (local address 127.1.55.253:39981)
0620 22:08:06.142049 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:06.142051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:06.142064 (+ 13us) server_negotiation.cc:407] Connection header received
0620 22:08:06.142134 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:06.142135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:06.142144 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:06.142186 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0620 22:08:06.142499 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35614: BlockingRecv error: recv got EOF from 127.0.0.1:35614 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260620 22:08:06.481621 24068 catalog_manager.cc:1259] Loaded cluster ID: c13c9df3e127414d9f0f18fdd98ca31d
I20260620 22:08:06.481676 24068 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931: loading cluster ID for follower catalog manager: success
I20260620 22:08:06.482359 24068 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931: acquiring CA information for follower catalog manager: success
I20260620 22:08:06.482571 24068 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e909ddb7610a468fa11ee7c03a0f6931: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 22:08:06.566439 24111 catalog_manager.cc:1259] Loaded cluster ID: c13c9df3e127414d9f0f18fdd98ca31d
I20260620 22:08:06.566498 24111 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694: loading cluster ID for follower catalog manager: success
I20260620 22:08:06.567175 24111 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694: acquiring CA information for follower catalog manager: success
I20260620 22:08:06.567396 24111 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e1902d19e1424ac0bd0d5f0e10e2d694: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 22:08:06.657907 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:06.655659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35618 (local address 127.1.55.253:39981)
0620 22:08:06.655749 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:06.655751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:06.655760 (+ 9us) server_negotiation.cc:407] Connection header received
0620 22:08:06.655826 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:06.655827 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:06.655866 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:06.655930 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:06.656071 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.656555 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.657224 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.657391 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.657436 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:06.657598 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:06.657691 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:06.657747 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:06.657778 (+ 31us) server_negotiation.cc:299] Negotiation successful
0620 22:08:06.657794 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73,"thread_start_us":48,"threads_started":1}
I20260620 22:08:06.661551 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:06.659539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37810 (local address 127.1.55.252:45895)
0620 22:08:06.659654 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:06.659656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:06.659664 (+ 8us) server_negotiation.cc:407] Connection header received
0620 22:08:06.659695 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:06.659696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:06.659728 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:06.659790 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:06.659892 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.660306 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.660923 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.661087 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.661129 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:06.661255 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:06.661329 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:06.661378 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:06.661408 (+ 30us) server_negotiation.cc:299] Negotiation successful
0620 22:08:06.661423 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":55,"threads_started":1}
I20260620 22:08:06.665614 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:06.663067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35628 (local address 127.1.55.253:39981)
0620 22:08:06.663097 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:06.663098 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:06.663304 (+ 206us) server_negotiation.cc:407] Connection header received
0620 22:08:06.663358 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:06.663359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:06.663367 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:06.663415 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:06.663501 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.664089 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.664960 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.665153 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.665222 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:06.665367 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:06.665393 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:06.665434 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:06.665529 (+ 95us) server_negotiation.cc:299] Negotiation successful
0620 22:08:06.665555 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:08:06.665829 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:06.663247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37814 (local address 127.1.55.252:45895)
0620 22:08:06.663279 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:06.663280 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:06.663308 (+ 28us) server_negotiation.cc:407] Connection header received
0620 22:08:06.663369 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:06.663369 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:06.663378 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:06.663419 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:06.663547 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.663995 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.664941 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.665211 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.665260 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:06.665425 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:06.665453 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:06.665548 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:06.665753 (+ 205us) server_negotiation.cc:299] Negotiation successful
0620 22:08:06.665771 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260620 22:08:06.666260 24197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0620 22:08:06.663048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59060 (local address 127.1.55.254:38599)
0620 22:08:06.663414 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0620 22:08:06.663416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0620 22:08:06.663422 (+ 6us) server_negotiation.cc:407] Connection header received
0620 22:08:06.663458 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 22:08:06.663459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 22:08:06.663502 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 22:08:06.663564 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0620 22:08:06.663723 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.664307 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.665203 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 22:08:06.665478 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 22:08:06.665587 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 22:08:06.665817 (+ 230us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0620 22:08:06.665977 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0620 22:08:06.666042 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0620 22:08:06.666154 (+ 112us) server_negotiation.cc:299] Negotiation successful
0620 22:08:06.666182 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":39,"threads_started":1}
I20260620 22:08:06.672624 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23833
I20260620 22:08:06.677739 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23908
I20260620 22:08:06.682544 1247 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskKulyh2/build/release/bin/kudu with pid 23983
2026-06-20T22:08:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2739 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5446 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (284710 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS